-- Logs begin at Wed 2022-10-19 12:34:04 UTC, end at Wed 2022-10-19 14:08:29 UTC. -- Oct 19 13:05:30.257820 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 13:05:30.267214 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 13:05:30 2022] *** Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: nodename: dv-cinder-master-3-iscsi Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: machine: x86_64 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: clock source: unix Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: pcre jit disabled Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: detected number of CPU cores: 4 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: current working directory: / Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: detected binary path: /usr/bin/uwsgi-core Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: your processes number limit is 47680 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: your memory page size is 4096 bytes Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: detected max file descriptor number: 2048 Oct 19 13:05:30.269458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: lock engine: pthread robust mutexes Oct 19 13:05:30.270369 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: thunder lock: enabled Oct 19 13:05:30.270369 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 13:05:30.270369 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 13:05:30.309889 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: Python main interpreter initialized at 0x55644de0f9c0 Oct 19 13:05:30.309889 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: python threads support enabled Oct 19 13:05:30.309889 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: your server socket listen backlog is limited to 100 connections Oct 19 13:05:30.309889 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: your mercy for graceful operations on workers is 90 seconds Oct 19 13:05:30.310341 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 13:05:30.310341 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: *** Operational MODE: preforking *** Oct 19 13:05:30.310633 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: *** uWSGI is running in multiple interpreter mode *** Oct 19 13:05:30.310633 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: spawned uWSGI master process (pid: 103968) Oct 19 13:05:30.310865 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 13:05:30.312822 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: spawned uWSGI worker 1 (pid: 103969, cores: 1) Oct 19 13:05:30.312822 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: spawned uWSGI worker 2 (pid: 103970, cores: 1) Oct 19 13:05:30.312822 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 13:05:30.979607 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:05:30.990392 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:05:32.077994 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:05:32.077994 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: from cryptography.utils import int_from_bytes Oct 19 13:05:32.078968 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:05:32.078968 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: from cryptography.utils import int_from_bytes Oct 19 13:05:32.079204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:05:32.079204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: from cryptography.utils import int_from_bytes Oct 19 13:05:32.079204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:05:32.079204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: from cryptography.utils import int_from_bytes Oct 19 13:05:34.584830 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:05:34.585749 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:05:34.585846 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:05:34.586271 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:05:34.586351 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:05:34.586424 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:05:34.586424 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:05:34.586554 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:05:34.586620 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.586695 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:05:34.586766 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:05:34.586831 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587140 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587248 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587473 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587680 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587844 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.587992 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588160 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588315 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588447 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588583 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588717 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.588845 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589048 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589197 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589332 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589477 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589601 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589732 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.589928 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590017 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590205 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590399 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590563 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590706 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590849 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.590974 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591101 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591220 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591486 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591628 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591730 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.591816 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.592030 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.592168 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.592330 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.592552 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.592692 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593027 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593154 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593302 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593431 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593625 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593719 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.593964 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594076 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594266 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594417 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594578 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594720 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.594909 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595044 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595230 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595369 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595525 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595671 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595852 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.595975 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.596159 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.596289 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.596556 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.596739 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.596899 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597038 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597165 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597303 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597498 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597664 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.597907 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598033 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598215 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598346 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598508 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598641 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598839 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.598970 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599151 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599277 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599450 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599577 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599770 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.599898 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.600088 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.600234 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.600538 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.600728 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.600894 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601036 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601158 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601387 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601505 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601628 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601751 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.601877 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602082 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602211 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602338 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602465 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602596 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602727 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602853 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.602977 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603133 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603260 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603461 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603599 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603789 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.603965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604073 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604193 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604308 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604421 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604573 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.604829 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.605057 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.605258 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.605442 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.605633 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.605822 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.606009 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.606200 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.606408 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.606602 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.606803 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.607009 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.607199 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.607425 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.607746 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.607953 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.608157 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.608364 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.608568 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.608779 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609037 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609245 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609443 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609632 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609822 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.609992 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610116 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610233 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610351 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610476 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610605 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610605 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610845 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.610845 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611075 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611201 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611325 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611453 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611580 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611705 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611823 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.611939 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612166 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612299 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612424 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612550 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612675 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612808 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.612967 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613097 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613221 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613339 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613456 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613572 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613699 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613825 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.613948 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614066 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614189 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614305 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614442 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614567 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614694 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.614911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615041 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615161 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615287 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615405 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615529 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615675 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615832 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.615972 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616098 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616240 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616366 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616490 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616619 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616746 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.616951 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617072 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617202 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617321 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617438 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617563 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617697 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.617900 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618013 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618129 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618247 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618374 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618499 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618622 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618740 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618865 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.618983 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619175 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619288 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619395 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619518 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619636 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619762 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.619881 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620013 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620141 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620260 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620376 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620500 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620631 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620755 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.620899 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621099 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621236 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621421 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621557 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621712 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.621837 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622028 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622157 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622348 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622479 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622647 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622770 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.622952 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623077 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623265 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623389 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623561 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623695 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.623869 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624000 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624185 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624310 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624492 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624631 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.624780 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625050 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625190 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625312 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625440 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625564 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625683 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625800 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.625983 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626109 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626292 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626417 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626586 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.626889 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627012 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627200 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627334 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627519 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627659 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.627817 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628018 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628141 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628266 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628386 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628513 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628706 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.628838 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:05:34.629071 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.629197 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.629400 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.629535 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.629743 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.629868 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630057 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630181 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630383 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630510 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630712 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.630838 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631028 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631154 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631336 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631463 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631713 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.631841 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.632032 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.632282 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.632402 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.632700 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.632823 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633042 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633177 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633364 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633496 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633716 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633847 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.633973 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634089 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634305 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634438 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634622 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634756 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.634935 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635071 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635278 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635400 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635528 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635654 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635858 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.635984 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.636186 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.636321 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.636506 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.636631 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.636818 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637007 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637167 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637458 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637584 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637703 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637829 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.637948 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638120 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638235 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638448 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638574 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638755 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.638882 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639064 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639203 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639363 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639496 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639702 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.639836 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640018 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640149 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640313 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640433 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640623 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640757 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.640956 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641078 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641273 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641404 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641583 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641713 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.641895 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642024 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642203 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642331 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642513 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642634 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642821 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.642941 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643156 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643277 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643466 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643600 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643781 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.643902 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644093 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644214 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644406 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644530 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644717 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.644838 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645055 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645187 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645365 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645487 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645670 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645798 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.645974 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646090 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646278 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646399 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646581 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646707 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.646883 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.647011 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.647248 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.647378 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.647678 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.647802 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648053 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648182 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648362 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648484 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648833 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.648978 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.649408 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.649540 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.649758 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.649950 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.650072 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.650399 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.650531 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.650741 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.651035 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.651181 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.651381 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.651560 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.651713 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652005 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652126 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652328 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652492 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652658 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.652979 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.653105 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.653427 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.653549 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.653850 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.653983 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.654218 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.654343 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.654611 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.654834 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.654957 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.655339 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.655469 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.655666 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.655787 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.655980 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656100 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656294 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656418 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656618 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656739 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.656967 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657100 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657291 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657415 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657634 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657812 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.657957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658085 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658257 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658394 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658601 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658731 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.658935 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.659056 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.659242 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.659535 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.659657 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.659841 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.660134 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.660273 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.660442 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.660719 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.660843 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.661063 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.661334 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.661471 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.661657 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.661894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.662017 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.662281 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.662468 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.662605 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.662977 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.663102 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.663328 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.663603 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.663775 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.664005 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.664130 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.664248 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.664373 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.664911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665053 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665235 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665365 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665553 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665678 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.665869 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666000 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666181 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666296 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666513 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666642 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666829 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.666963 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667142 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667270 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667452 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667571 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667767 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.667940 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668097 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668237 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668367 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668497 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668659 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.668798 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669011 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669179 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669326 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669448 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669649 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669773 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.669954 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670076 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670272 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670401 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670614 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670736 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.670943 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671070 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671261 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671388 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671576 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671697 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.671887 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672006 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672204 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672325 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672514 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672643 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.672826 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673143 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673266 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673462 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673584 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673783 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.673904 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.674097 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.674267 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.674401 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.674637 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.674851 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675024 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675156 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675452 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675597 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675740 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.675873 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676082 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676302 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676422 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676647 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676769 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.676994 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677117 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677321 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677456 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677639 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677762 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.677969 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.678102 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.678261 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.678448 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.678682 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.678813 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.679057 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.679255 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.679378 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.679677 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.679801 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680007 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680129 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680323 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680453 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680637 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680762 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.680977 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681136 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681269 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681408 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681586 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681716 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.681899 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682021 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682207 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682339 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682514 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682638 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682829 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.682952 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683151 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683286 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683461 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683581 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683775 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.683897 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684090 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684229 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684394 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684524 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684699 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.684820 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685048 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685182 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685362 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685482 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685663 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685783 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.685985 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686110 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686260 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686382 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686575 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686698 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.686893 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.687019 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.687196 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.687325 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.690617 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.690799 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.690945 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691073 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691198 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691320 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691439 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691570 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691704 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691824 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.691943 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692069 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692192 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692313 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692416 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692532 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692650 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692766 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.692766 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693019 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693139 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693255 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693255 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693463 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693581 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693707 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693826 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693943 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.693943 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694231 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694362 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694490 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694490 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.694941 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695066 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695185 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695310 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695434 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695434 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695655 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695863 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.695985 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696103 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696230 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696348 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696468 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696585 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696709 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696838 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.696989 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697111 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697229 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697346 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697474 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697584 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697701 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697819 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.697936 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698053 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698179 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698297 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698415 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698533 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698657 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698785 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.698903 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699020 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699129 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699248 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699365 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699492 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699612 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699612 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699833 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.699941 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700058 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700192 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700312 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700431 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700431 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700687 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.700989 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701128 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701262 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701391 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701510 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701628 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701747 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701865 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.701993 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702119 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702239 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702357 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702475 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702593 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702719 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702840 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.702958 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703082 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703255 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703387 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703562 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703683 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.703899 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704019 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704202 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704337 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704514 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704637 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704818 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.704967 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705145 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705280 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705448 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705570 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705754 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.705878 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706066 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706196 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706365 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706485 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706676 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706795 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.706980 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707101 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707282 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707402 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707595 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707710 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.707896 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708018 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708198 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708319 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708501 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708635 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708803 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.708943 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709144 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709266 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709447 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709569 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709804 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.709934 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710116 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710303 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710459 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710590 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710710 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.710828 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711040 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711164 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711288 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711416 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711592 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711714 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.711904 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712025 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712209 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712339 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712517 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712638 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.712817 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713002 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713135 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713257 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713435 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713551 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713743 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.713866 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714049 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714171 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714350 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714471 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714661 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714784 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.714966 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715144 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715264 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715381 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715559 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715680 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715867 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.715987 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716169 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716288 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716471 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716591 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716777 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.716916 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717103 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717224 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717415 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717618 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717739 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.717847 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718012 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718138 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718312 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718446 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718615 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718737 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.718914 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719042 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719218 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719342 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719522 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719651 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719822 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.719942 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720120 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720249 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720421 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720543 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720725 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.720846 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721059 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721196 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721372 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721474 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721673 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721775 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.721973 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722071 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722284 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722381 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722596 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722694 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.722910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723023 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723210 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723316 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723518 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723629 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723823 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.723921 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724129 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724228 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724441 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724556 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724741 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.724841 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725070 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725169 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725466 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725575 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725770 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.725861 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726076 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726170 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726379 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726486 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726680 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726834 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.726982 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.727079 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.727286 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.727386 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.727593 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.727691 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728011 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728163 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728249 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728361 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728520 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728596 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728842 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.728951 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729170 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729252 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729482 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729568 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729792 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.729865 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730102 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730177 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730413 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730497 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730724 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.730817 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731028 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731128 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731341 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731430 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731648 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731740 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.731958 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732052 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732258 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732340 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732562 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732658 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732893 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.732982 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733201 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733285 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733505 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733606 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733824 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.733904 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734135 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734280 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734430 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734572 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734735 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.734881 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735023 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735164 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735318 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735457 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735633 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735762 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.735945 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736085 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736238 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736390 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736533 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736673 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.736918 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737072 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737233 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737375 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737529 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737677 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737820 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.737956 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738146 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738291 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738432 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738574 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738714 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.738881 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739004 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739199 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739333 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739516 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739621 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.739831 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740010 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740140 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740244 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740439 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740531 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740749 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.740854 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741121 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741441 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741580 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741747 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.741866 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742052 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742179 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742379 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742472 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742686 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.742771 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743009 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743099 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743381 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743473 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743699 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.743783 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744002 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744085 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744421 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744517 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744735 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.744817 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745068 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745164 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745380 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745474 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745687 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745820 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.745988 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746079 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746298 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746386 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746613 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746695 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.746915 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747051 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747219 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747304 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747521 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747605 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747844 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.747939 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748146 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748236 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748451 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748542 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748776 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.748892 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749126 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749213 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749442 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749528 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.749863 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750180 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750272 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750490 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750575 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750799 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.750882 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751123 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751215 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751446 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751567 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751747 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.751831 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752049 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752141 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752359 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752448 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752661 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752744 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.752990 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753101 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753312 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753396 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753614 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753699 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.753917 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754009 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754226 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754316 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754536 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754621 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754846 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.754938 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755152 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755236 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755472 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755583 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755777 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.755867 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756100 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756192 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756415 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756564 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756792 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.756929 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757225 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757479 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757568 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757706 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757865 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.757988 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758141 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758300 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758425 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758606 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758750 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.758913 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759057 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759220 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759370 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759567 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759684 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.759909 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760051 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760204 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760291 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760532 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760618 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.760943 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761033 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761194 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761278 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761513 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761599 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761828 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.761911 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762147 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762244 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762459 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762553 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762762 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.762846 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763088 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763181 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763391 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763475 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763691 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763776 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.763998 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764091 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764301 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764433 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764604 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764690 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.764945 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765047 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765257 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765342 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765561 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765646 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765864 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.765950 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766165 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766250 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766491 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766594 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766797 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.766889 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767136 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767222 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767429 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767513 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767735 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.767821 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768040 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768131 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768342 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768427 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768647 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768792 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.768995 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769142 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769278 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769504 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769650 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769798 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.769967 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770108 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770240 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770385 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770526 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770667 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770796 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.770928 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771057 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771188 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771321 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771445 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771584 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771756 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.771912 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.772075 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.772302 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.772463 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.772673 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.772856 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.773085 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.773222 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.773396 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.773535 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.773743 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774049 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774197 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774380 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774680 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774751 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.774999 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775094 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775317 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775410 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775633 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775729 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.775949 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776064 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776260 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776375 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776577 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776690 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.776902 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777028 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777219 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777350 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777527 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777610 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777844 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.777930 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.778161 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.778245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.778478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.778563 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.778808 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779040 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779125 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779370 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779490 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779687 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.779772 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780005 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780122 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780318 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780413 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780632 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780726 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.780967 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781056 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781279 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781377 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781591 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781676 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781902 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.781986 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.782256 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.782382 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.782518 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.782609 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.782831 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783063 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783155 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783234 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783438 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783524 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783752 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.783837 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784069 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784154 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784447 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784671 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784754 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.784961 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785067 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785136 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785357 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785461 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785671 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.785942 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786202 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786292 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786360 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786515 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786615 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.786846 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.787018 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.787158 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.787324 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.787497 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788062 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788149 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788217 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788282 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788388 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788488 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788730 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.788927 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.789072 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.789225 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.789388 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.789871 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790057 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790179 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790392 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790518 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790716 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.790806 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791031 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791121 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791352 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791441 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791659 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791754 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.791977 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.792203 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.792337 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.792499 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.792818 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.792932 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793191 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793347 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793513 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793635 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793833 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.793946 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794147 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794252 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794480 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794616 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794787 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.794940 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795075 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795214 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795389 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795523 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795698 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.795840 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796003 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796140 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796317 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796449 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796627 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.796777 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797019 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797155 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797286 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797444 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797593 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797728 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.797872 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798089 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798240 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798435 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798584 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798748 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.798873 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799054 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799186 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799361 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799506 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799671 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.799803 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800004 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800139 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800265 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800409 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800601 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800726 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800848 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.800999 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801176 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801316 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801490 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801617 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801796 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.801928 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802077 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802276 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802416 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802546 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802688 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802818 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.802970 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.803095 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.803269 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.803710 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.803853 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.803991 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804146 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804287 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804431 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804567 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804704 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.804856 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805104 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805248 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805389 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805527 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805678 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805824 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.805965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806095 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806222 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806352 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806482 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806621 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806750 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.806880 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807014 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807234 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807440 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807593 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807774 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.807905 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808097 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808234 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808435 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808574 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808743 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.808921 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809087 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809215 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809392 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809524 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809692 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.809786 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810011 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810140 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810322 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810411 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810638 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810727 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.810946 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811034 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811254 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811343 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811565 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811655 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811875 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.811964 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.812187 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.812433 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.812512 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.812765 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.812845 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813110 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813192 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813432 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813510 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813743 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.813821 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814048 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814126 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814353 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814432 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814655 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814754 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.814978 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815103 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815288 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815377 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815600 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815774 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.815907 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816004 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816213 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816301 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816520 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816616 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816832 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.816969 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817164 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817252 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817470 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817562 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817775 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.817882 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818084 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818220 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818391 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818481 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818696 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.818791 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.819216 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.819357 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.819476 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.819673 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.819766 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820019 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820178 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820385 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820533 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820675 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.820937 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821099 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821235 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821374 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821470 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821551 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821628 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821854 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.821944 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822163 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822260 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822471 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822560 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822788 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.822894 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823111 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823192 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823422 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823502 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823726 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.823813 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.824104 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.824414 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.824501 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.824724 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.824811 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825067 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825185 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825385 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825471 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825708 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825811 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.825993 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826070 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826302 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826428 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826609 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826709 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.826916 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827002 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827224 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827364 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827525 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827621 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827835 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.827929 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828188 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828279 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828494 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828593 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828807 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.828960 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829138 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829223 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829443 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829529 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829760 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.829843 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830068 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830151 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830376 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830471 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830675 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830759 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.830977 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831069 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831282 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831367 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831581 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831671 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831881 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.831964 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832183 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832268 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832483 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832567 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832792 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.832911 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833118 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833215 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833419 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833511 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833719 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.833816 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834019 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834112 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834321 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834406 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834737 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.834892 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835069 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835154 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835405 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835489 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835717 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.835882 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836030 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836116 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836344 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836428 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836656 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836751 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.836993 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837083 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837307 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837404 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837633 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837717 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.837957 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838044 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838262 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838347 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838581 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838673 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838890 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.838975 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839209 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839293 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839524 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839612 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839838 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.839922 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840145 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840237 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840466 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840610 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840776 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.840887 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841109 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841208 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841420 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841505 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841730 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.841815 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842038 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842136 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842347 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842438 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842659 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842744 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.842977 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843101 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843280 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843363 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843603 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843689 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.843922 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844008 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844230 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844303 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844544 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844638 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.844855 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845020 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845203 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845297 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845513 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845606 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845823 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.845919 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846132 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846217 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846441 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846533 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846751 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.846845 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.847063 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.847149 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.847304 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:05:34.847401 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.847668 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.847983 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.848298 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.848622 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.848969 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.849279 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.849608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.849932 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.850331 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.850724 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.851126 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.851436 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.851747 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.852064 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.852369 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:05:34.852612 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:05:35.004885 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO dbcounter [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Registered counter for database nova_api Oct 19 13:05:35.009356 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO dbcounter [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Registered counter for database nova_api Oct 19 13:05:35.028201 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_db.sqlalchemy.engines [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.030248 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_db.sqlalchemy.engines [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.035355 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writer thread running {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.037466 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writer thread running {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.095059 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.context [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92222fa4-c6fd-435b-a56b-90c4f494d59a(cell1) {{(pid=103969) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:05:35.095277 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.context [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92222fa4-c6fd-435b-a56b-90c4f494d59a(cell1) {{(pid=103970) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:05:35.097476 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:05:35.097966 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:05:35.098914 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:05:35.099395 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:05:35.099526 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:05:35.100354 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:05:35.100807 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:05:35.101416 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:05:35.102229 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:05:35.102686 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:05:35.103010 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:05:35.104715 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_concurrency.lockutils [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:05:35.105101 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO dbcounter [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Registered counter for database nova_cell0 Oct 19 13:05:35.106801 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO dbcounter [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Registered counter for database nova_cell0 Oct 19 13:05:35.109485 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO dbcounter [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Registered counter for database nova_cell1 Oct 19 13:05:35.111179 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO dbcounter [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Registered counter for database nova_cell1 Oct 19 13:05:35.116747 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_db.sqlalchemy.engines [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.119534 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_db.sqlalchemy.engines [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.121846 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writer thread running {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.122545 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_db.sqlalchemy.engines [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.123198 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_db.sqlalchemy.engines [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.126615 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writer thread running {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.265389 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writer thread running {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.273804 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writer thread running {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.276184 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO dbcounter [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Registered counter for database nova_cell0 Oct 19 13:05:35.285127 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO dbcounter [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Registered counter for database nova_cell0 Oct 19 13:05:35.285829 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_db.sqlalchemy.engines [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.291862 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writer thread running {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.296443 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG oslo_db.sqlalchemy.engines [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:05:35.303311 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writer thread running {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:05:35.636133 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: WARNING keystonemiddleware.auth_token [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:05:35.642273 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: WARNING keystonemiddleware.auth_token [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:05:35.644057 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: WARNING keystonemiddleware.auth_token [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:05:35.651625 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: WARNING keystonemiddleware.auth_token [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:05:35.993643 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: WARNING keystonemiddleware.auth_token [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:05:35.999660 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: WARNING keystonemiddleware.auth_token [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:05:36.005120 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55644de0f9c0 pid: 103969 (default app) Oct 19 13:05:36.005538 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: WARNING keystonemiddleware.auth_token [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:05:36.007380 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:05:36.008625 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001947 Oct 19 13:05:36.009048 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Oct 19 13:05:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:05:36.011844 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: WARNING keystonemiddleware.auth_token [None req-989016c4-7c86-45f9-89d4-7def56c18702 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:05:36.017253 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55644de0f9c0 pid: 103970 (default app) Oct 19 13:07:01.334905 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:01.336031 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Oct 19 13:07:01.336744 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:01.353932 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_api:SELECT=3 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:01.355597 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_cell0:SELECT=3 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:01.356331 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_cell1:SELECT=3 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:01.357392 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:02.230154 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-9be46922-e3f2-440b-95d3-9046a3787ef0 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:02.264323 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-9be46922-e3f2-440b-95d3-9046a3787ef0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920848 Oct 19 13:07:02.265278 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Oct 19 13:07:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:04.857253 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:04.858285 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-c8169772-5625-4fb6-885c-bd598f7e6275 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 19 13:07:04.863502 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:05.334675 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-4c92aea6-9eba-471c-85b5-4a001981c77d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:05.384719 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-4c92aea6-9eba-471c-85b5-4a001981c77d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519688 Oct 19 13:07:05.385308 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:07:05.399557 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=3 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:05.400397 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_cell1:SELECT=3 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:05.402448 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_cell0:SELECT=3 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:05.403184 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:05.606302 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-9aa8cf9e-7eaf-410a-b2de-88e014216f0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:05.677778 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-9aa8cf9e-7eaf-410a-b2de-88e014216f0d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283675 Oct 19 13:07:05.680395 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Oct 19 13:07:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:08.343012 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-4c92aea6-9eba-471c-85b5-4a001981c77d admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:08.344029 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-4c92aea6-9eba-471c-85b5-4a001981c77d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 19 13:07:08.344426 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:09.102098 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-e8b80968-e7aa-4731-b56e-71e2593bd570 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:09.149915 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-e8b80968-e7aa-4731-b56e-71e2593bd570 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.798650 Oct 19 13:07:09.150631 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:07:09.163609 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-0dc49b8e-80e2-40ca-bf11-b4709c2ce44c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:09.205517 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-0dc49b8e-80e2-40ca-bf11-b4709c2ce44c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046480 Oct 19 13:07:09.206125 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Oct 19 13:07:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:07:11.971827 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-e8b80968-e7aa-4731-b56e-71e2593bd570 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:11.972954 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-e8b80968-e7aa-4731-b56e-71e2593bd570 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Oct 19 13:07:11.973383 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:12.471775 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-1270e98e-e562-4f87-969c-b6473394182d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:12.492692 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-1270e98e-e562-4f87-969c-b6473394182d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511284 Oct 19 13:07:12.493297 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:07:12.506116 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-7104a120-61bd-429c-92fd-cb8bb23cdaea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:12.543353 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-7104a120-61bd-429c-92fd-cb8bb23cdaea admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041313 Oct 19 13:07:12.544587 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Oct 19 13:07:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:15.308253 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-1270e98e-e562-4f87-969c-b6473394182d admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:15.309332 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-1270e98e-e562-4f87-969c-b6473394182d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 19 13:07:15.315657 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:15.860655 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-3bc8990f-c825-4875-84ef-8586ac2c081b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:15.887050 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-3bc8990f-c825-4875-84ef-8586ac2c081b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.570328 Oct 19 13:07:15.887875 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:07:15.902338 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-282698ea-223b-4998-ac13-35d8775562db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:15.938085 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-282698ea-223b-4998-ac13-35d8775562db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039902 Oct 19 13:07:15.938773 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Oct 19 13:07:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:18.747214 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-3bc8990f-c825-4875-84ef-8586ac2c081b admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:18.748229 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-3bc8990f-c825-4875-84ef-8586ac2c081b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 19 13:07:18.748799 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:19.335455 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:19.361272 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.603214 Oct 19 13:07:19.362085 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:07:19.379670 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-26c438b4-54fc-4662-b2f2-0905506b5d81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:19.413377 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-26c438b4-54fc-4662-b2f2-0905506b5d81 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037140 Oct 19 13:07:19.414027 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Wed Oct 19 13:07:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:22.494525 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:22.495573 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Oct 19 13:07:22.495988 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:23.064067 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-04dbf59f-45ba-44dd-ab9b-3bf4c8b56bf6 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:23.090423 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-04dbf59f-45ba-44dd-ab9b-3bf4c8b56bf6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.585015 Oct 19 13:07:23.091101 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Oct 19 13:07:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:07:25.801871 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:25.802743 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-7db5fba5-ac36-4810-9325-e2f16d33eda0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Oct 19 13:07:25.803149 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:26.288384 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-8ef022c3-51df-4390-a86b-2ebdd1eb619f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:26.318803 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-8ef022c3-51df-4390-a86b-2ebdd1eb619f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.508716 Oct 19 13:07:26.319457 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:07:26.331762 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-db6c2f11-4343-41ec-822c-e27c09ecee9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:26.363946 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-db6c2f11-4343-41ec-822c-e27c09ecee9c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035788 Oct 19 13:07:26.364570 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Oct 19 13:07:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:29.044261 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-8ef022c3-51df-4390-a86b-2ebdd1eb619f admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:29.045304 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-8ef022c3-51df-4390-a86b-2ebdd1eb619f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 19 13:07:29.045674 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:29.478863 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-5317b126-b45b-4e91-822c-60a36cd6187c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "swap": 0, "disk": 20, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:29.505111 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-5317b126-b45b-4e91-822c-60a36cd6187c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451231 Oct 19 13:07:29.506263 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:07:29.518237 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-2e38f75c-5141-45f5-8f86-cb9dbe75fc50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:29.546894 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-2e38f75c-5141-45f5-8f86-cb9dbe75fc50 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032434 Oct 19 13:07:29.548895 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Oct 19 13:07:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:32.362086 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-5317b126-b45b-4e91-822c-60a36cd6187c admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:32.363817 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-5317b126-b45b-4e91-822c-60a36cd6187c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002206 Oct 19 13:07:32.364464 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:32.897873 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-76480788-70d0-4907-b233-8227c56ca32d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:32.923271 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-76480788-70d0-4907-b233-8227c56ca32d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.551769 Oct 19 13:07:32.923939 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:07:32.938751 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-caf7c1b9-dc36-45ea-862a-871a8c821832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:32.944207 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:32.981505 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-caf7c1b9-dc36-45ea-862a-871a8c821832 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048581 Oct 19 13:07:32.982618 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Oct 19 13:07:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:35.837525 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-76480788-70d0-4907-b233-8227c56ca32d admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:35.838803 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-76480788-70d0-4907-b233-8227c56ca32d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 19 13:07:35.839528 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:36.336740 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-6862b7bf-77ec-4a3a-b7f5-b487c2a94d71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:36.366466 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-6862b7bf-77ec-4a3a-b7f5-b487c2a94d71 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520394 Oct 19 13:07:36.368933 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:07:36.379508 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-b267b057-5a77-41df-b287-801f02ebf8ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:36.392942 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:36.407308 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-b267b057-5a77-41df-b287-801f02ebf8ab admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031485 Oct 19 13:07:36.407827 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Oct 19 13:07:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:39.067051 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-6862b7bf-77ec-4a3a-b7f5-b487c2a94d71 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:39.068525 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-6862b7bf-77ec-4a3a-b7f5-b487c2a94d71 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Oct 19 13:07:39.069381 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:39.631767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:39.656254 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.580422 Oct 19 13:07:39.657232 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Wed Oct 19 13:07:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:07:39.671007 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-4d01fb9e-355f-4031-b4cc-c1ab70590f4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:07:39.715828 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-4d01fb9e-355f-4031-b4cc-c1ab70590f4f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048449 Oct 19 13:07:39.716399 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Wed Oct 19 13:07:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:07:55.821154 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:55.822230 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 19 13:07:55.822685 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:55.834735 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:56.274418 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-f2ee880f-6e8f-473e-b614-bec4b4e682f7 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:56.295185 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-f2ee880f-6e8f-473e-b614-bec4b4e682f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.465313 Oct 19 13:07:56.295746 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Oct 19 13:07:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:07:57.630091 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:57.631346 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-02c3c2de-9ae9-4e00-af9e-10659b30f940 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Oct 19 13:07:57.631750 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:07:58.191492 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-214b2731-a0b2-4c0f-9a5a-0626ba67bc3b admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:58.197095 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.wsgi [None req-214b2731-a0b2-4c0f-9a5a-0626ba67bc3b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-214b2731-a0b2-4c0f-9a5a-0626ba67bc3b admin admin] Request method failure captured: Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept: application/json Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept-Encoding: gzip, deflate Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Connection: keep-alive Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Content-Length: 0 Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Host: 10.222.0.17 Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-Api-Version: compute 2.92 Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-System-Scope: None Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: User-Agent: python-novaclient Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Auth-Token: gAAAAABjT_at_AFtvssPRSqbbh5hBjCVSW-xQvcMsl3LN2thS83BAn-6bFNLl38_YGy6qnxOAwAVcgmZfhum04EXb14HwZqDwHBTsApNUTMRWRtrWFBs0wIwHs6aK14SQjCaNza7L-Jif4--fbhCT5oy7hdkF0HBVRE3ZBShHBp0rj7FjttnCDs Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Id: None Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Name: None Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Identity-Status: Confirmed Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Is-Admin-Project: True Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Id: default Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Name: Default Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Name: admin Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Role: reader,admin,member Oct 19 13:07:58.200349 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Roles: reader,admin,member Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant: admin Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Name: admin Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User: admin Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Id: default Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Name: Default Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Name: admin Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: method: > Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: exception: Flavor 42 could not be found. Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: action_args: {'id': '42'} Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:07:58.201957 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:07:58.202911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.204061 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-214b2731-a0b2-4c0f-9a5a-0626ba67bc3b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:07:58.205168 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-214b2731-a0b2-4c0f-9a5a-0626ba67bc3b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.434783 Oct 19 13:07:58.205168 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Oct 19 13:07:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:07:58.212000 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6f8d8a9f-9585-4720-a529-0b59ecc480e3 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:58.216199 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:07:58.238434 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-6f8d8a9f-9585-4720-a529-0b59ecc480e3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030060 Oct 19 13:07:58.239008 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:07:58.250136 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-3d2aa50b-acfc-4b4f-aeef-30e42928fc97 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:58.272511 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-3d2aa50b-acfc-4b4f-aeef-30e42928fc97 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026929 Oct 19 13:07:58.273140 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:07:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:07:58.283130 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-16c99697-b8ce-488b-a36c-37fe9b96a587 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:58.290008 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.wsgi [None req-16c99697-b8ce-488b-a36c-37fe9b96a587 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-16c99697-b8ce-488b-a36c-37fe9b96a587 admin admin] Request method failure captured: Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept: application/json Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept-Encoding: gzip, deflate Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Connection: keep-alive Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Content-Length: 0 Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Host: 10.222.0.17 Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-Api-Version: compute 2.92 Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-System-Scope: None Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: User-Agent: python-novaclient Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Auth-Token: gAAAAABjT_at_AFtvssPRSqbbh5hBjCVSW-xQvcMsl3LN2thS83BAn-6bFNLl38_YGy6qnxOAwAVcgmZfhum04EXb14HwZqDwHBTsApNUTMRWRtrWFBs0wIwHs6aK14SQjCaNza7L-Jif4--fbhCT5oy7hdkF0HBVRE3ZBShHBp0rj7FjttnCDs Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Id: None Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Name: None Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Identity-Status: Confirmed Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Is-Admin-Project: True Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Id: default Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Name: Default Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Name: admin Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Role: reader,admin,member Oct 19 13:07:58.293439 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Roles: reader,admin,member Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant: admin Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Name: admin Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User: admin Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Id: default Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Name: Default Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Name: admin Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: method: > Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: exception: Flavor 42 could not be found. Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: action_args: {'id': '42'} Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:07:58.294720 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:07:58.295579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:07:58.296910 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-16c99697-b8ce-488b-a36c-37fe9b96a587 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:07:58.298138 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-16c99697-b8ce-488b-a36c-37fe9b96a587 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015718 Oct 19 13:07:58.298138 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Oct 19 13:07:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 13:07:59.527940 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-3d2aa50b-acfc-4b4f-aeef-30e42928fc97 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:07:59.529021 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-3d2aa50b-acfc-4b4f-aeef-30e42928fc97 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Oct 19 13:07:59.529423 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:00.125339 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6baf8e48-dd81-4f4e-afcb-a9f10a040f21 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:00.131154 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.wsgi [None req-6baf8e48-dd81-4f4e-afcb-a9f10a040f21 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6baf8e48-dd81-4f4e-afcb-a9f10a040f21 admin admin] Request method failure captured: Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept: application/json Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept-Encoding: gzip, deflate Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Connection: keep-alive Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Content-Length: 0 Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Host: 10.222.0.17 Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-Api-Version: compute 2.92 Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-System-Scope: None Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: User-Agent: python-novaclient Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Auth-Token: gAAAAABjT_avLEF_hQash7ExakVkCjliXQMT0rVPO9opzEmN-kfL36hJ_xku-HK7izRbCBL0SIzkQp8jmua3VfETyE3H_uexQNYVZ47E3GHlQ7jNaGLgANN7V8VEOOe9VDq-hcOCGx4sHEoiw1XJCkUJnJGZuEAxvZJHz4uKmDdZohd5u2guy-k Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Id: None Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Name: None Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Identity-Status: Confirmed Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Is-Admin-Project: True Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Id: default Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Name: Default Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Name: admin Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Role: reader,admin,member Oct 19 13:08:00.132693 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Roles: reader,admin,member Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant: admin Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Name: admin Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User: admin Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Id: default Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Name: Default Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Name: admin Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: method: > Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: exception: Flavor 84 could not be found. Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: action_args: {'id': '84'} Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:08:00.134243 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:00.135245 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.136767 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6baf8e48-dd81-4f4e-afcb-a9f10a040f21 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:08:00.138096 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-6baf8e48-dd81-4f4e-afcb-a9f10a040f21 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.466735 Oct 19 13:08:00.138096 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Oct 19 13:07:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 13:08:00.144335 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-a543c332-da88-4c58-bd48-f3c7eed046e1 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:00.160236 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-a543c332-da88-4c58-bd48-f3c7eed046e1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019403 Oct 19 13:08:00.160814 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:08:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:08:00.171599 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-e95057bc-b4f7-4a40-8aea-f4ddb72fb7f3 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:00.187996 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-e95057bc-b4f7-4a40-8aea-f4ddb72fb7f3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020045 Oct 19 13:08:00.188546 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:08:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:08:00.198688 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-3acc8b85-57d0-4522-af17-e1c83eebae77 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:00.203911 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.wsgi [None req-3acc8b85-57d0-4522-af17-e1c83eebae77 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-3acc8b85-57d0-4522-af17-e1c83eebae77 admin admin] Request method failure captured: Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept: application/json Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept-Encoding: gzip, deflate Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Connection: keep-alive Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Content-Length: 0 Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Host: 10.222.0.17 Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-Api-Version: compute 2.92 Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-System-Scope: None Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: User-Agent: python-novaclient Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Auth-Token: gAAAAABjT_avLEF_hQash7ExakVkCjliXQMT0rVPO9opzEmN-kfL36hJ_xku-HK7izRbCBL0SIzkQp8jmua3VfETyE3H_uexQNYVZ47E3GHlQ7jNaGLgANN7V8VEOOe9VDq-hcOCGx4sHEoiw1XJCkUJnJGZuEAxvZJHz4uKmDdZohd5u2guy-k Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Id: None Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Name: None Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Identity-Status: Confirmed Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Is-Admin-Project: True Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Id: default Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Name: Default Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Name: admin Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Role: reader,admin,member Oct 19 13:08:00.205478 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Roles: reader,admin,member Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant: admin Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Name: admin Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User: admin Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Id: default Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Name: Default Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Name: admin Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: method: > Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: exception: Flavor 84 could not be found. Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: action_args: {'id': '84'} Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:08:00.206965 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:00.207764 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-3acc8b85-57d0-4522-af17-e1c83eebae77 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:08:00.210371 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-3acc8b85-57d0-4522-af17-e1c83eebae77 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011867 Oct 19 13:08:00.210371 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Oct 19 13:08:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:08:01.465819 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-e95057bc-b4f7-4a40-8aea-f4ddb72fb7f3 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:01.466854 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-e95057bc-b4f7-4a40-8aea-f4ddb72fb7f3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 19 13:08:01.467249 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:02.030785 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-383b40fb-6d53-4580-8b6f-f0ba007419d1 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:02.037345 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.wsgi [None req-383b40fb-6d53-4580-8b6f-f0ba007419d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-383b40fb-6d53-4580-8b6f-f0ba007419d1 admin admin] Request method failure captured: Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept: application/json Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Accept-Encoding: gzip, deflate Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Connection: keep-alive Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Content-Length: 0 Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Host: 10.222.0.17 Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-Api-Version: compute 2.92 Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Openstack-System-Scope: None Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: User-Agent: python-novaclient Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Auth-Token: gAAAAABjT_axTbV5yI2EgaoDMN4Yg81cclpNmTgfYsLrKMMLkiH5rCtMwK8uh3NtUjDpYWnusKO58JLuQm7pq3ArMTr9BdSX-tZvQz_6JsIg-Opu61LrOCq07YUMtv50zqHcRc8lQvX_3lbAj0UxV6K1huc1iXpTYhY91rrix-PUC98b7x81cdc Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Id: None Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Domain-Name: None Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Identity-Status: Confirmed Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Is-Admin-Project: True Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Id: default Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Domain-Name: Default Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Project-Name: admin Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Role: reader,admin,member Oct 19 13:08:02.038884 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Roles: reader,admin,member Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant: admin Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-Tenant-Name: admin Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User: admin Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Id: default Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Domain-Name: Default Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: X-User-Name: admin Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: method: > Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: exception: Flavor 451 could not be found. Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: action_args: {'id': '451'} Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:08:02.040608 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:02.041547 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.042894 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-383b40fb-6d53-4580-8b6f-f0ba007419d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:08:02.044324 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-383b40fb-6d53-4580-8b6f-f0ba007419d1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.438162 Oct 19 13:08:02.044324 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:08:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 13:08:02.050511 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-151e65fe-5b8f-48d6-9af0-1545c8483c39 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:02.066643 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-151e65fe-5b8f-48d6-9af0-1545c8483c39 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019719 Oct 19 13:08:02.067214 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:08:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:08:02.077625 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:02.093870 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019810 Oct 19 13:08:02.094404 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Oct 19 13:08:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:08:02.104311 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6ea72ca9-db2c-4d7b-96e0-9b2ba5e113fb admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:02.112113 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.wsgi [None req-6ea72ca9-db2c-4d7b-96e0-9b2ba5e113fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6ea72ca9-db2c-4d7b-96e0-9b2ba5e113fb admin admin] Request method failure captured: Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept: application/json Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Accept-Encoding: gzip, deflate Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Connection: keep-alive Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Content-Length: 0 Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Host: 10.222.0.17 Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-Api-Version: compute 2.92 Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Openstack-System-Scope: None Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: User-Agent: python-novaclient Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Auth-Token: gAAAAABjT_axTbV5yI2EgaoDMN4Yg81cclpNmTgfYsLrKMMLkiH5rCtMwK8uh3NtUjDpYWnusKO58JLuQm7pq3ArMTr9BdSX-tZvQz_6JsIg-Opu61LrOCq07YUMtv50zqHcRc8lQvX_3lbAj0UxV6K1huc1iXpTYhY91rrix-PUC98b7x81cdc Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Id: None Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Domain-Name: None Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Identity-Status: Confirmed Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Is-Admin-Project: True Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Id: default Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Domain-Name: Default Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Project-Name: admin Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Role: reader,admin,member Oct 19 13:08:02.114732 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Roles: reader,admin,member Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3f76d628324944f7b5248c39cdf9ed0e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3f76d628324944f7b5248c39cdf9ed0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant: admin Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Id: 3f76d628324944f7b5248c39cdf9ed0e Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-Tenant-Name: admin Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User: admin Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Id: default Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Domain-Name: Default Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Id: ae1e4cab4304469eb20e077f0f0e5b13 Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: X-User-Name: admin Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: method: > Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: exception: Flavor 451 could not be found. Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: action_args: {'id': '451'} Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:08:02.117114 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:02.118419 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: ERROR nova.api.openstack.wsgi Oct 19 13:08:02.120115 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-6ea72ca9-db2c-4d7b-96e0-9b2ba5e113fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:08:02.121794 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-6ea72ca9-db2c-4d7b-96e0-9b2ba5e113fb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.015983 Oct 19 13:08:02.121794 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:08:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 13:08:03.369644 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:03.370675 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 19 13:08:03.371073 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:03.964605 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-5326ed51-c9f1-4ad2-b2e0-521b5b2bdb97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:08:03.989361 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-5326ed51-c9f1-4ad2-b2e0-521b5b2bdb97 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.479969 Oct 19 13:08:03.990041 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Oct 19 13:08:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:08:05.246745 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:05.247771 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 19 13:08:05.248168 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:05.818698 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-7e7ac035-0f28-41bf-8be9-eebc085eabd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:08:05.843007 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-7e7ac035-0f28-41bf-8be9-eebc085eabd9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.458307 Oct 19 13:08:05.843554 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Oct 19 13:08:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:08:07.105084 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:07.106601 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Oct 19 13:08:07.107294 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:07.675919 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-943a1d80-6ec6-463a-bf41-052ea6d77269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:08:07.698177 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-943a1d80-6ec6-463a-bf41-052ea6d77269 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.451056 Oct 19 13:08:07.698725 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Oct 19 13:08:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:08:08.931473 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:08.932500 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 19 13:08:08.932919 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:09.502705 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-b89f4a4f-44ae-49fd-9ec1-5ffdf9af2d1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:08:09.525553 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-b89f4a4f-44ae-49fd-9ec1-5ffdf9af2d1f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.450988 Oct 19 13:08:09.526106 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Oct 19 13:08:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:08:10.791284 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:10.792267 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 19 13:08:10.792686 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:08:11.356724 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-c1d2e43b-6159-4dca-af28-e4016c47f6f2 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:08:11.382580 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-c1d2e43b-6159-4dca-af28-e4016c47f6f2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.454525 Oct 19 13:08:11.383134 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Oct 19 13:08:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:09:09.299687 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.300722 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-b6e1c78d-48e2-4add-ad7d-ffca9e7ff6c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 19 13:09:09.301178 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:09:09.312387 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:09:09.763787 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-7d84084b-3796-4872-b72d-71f25c557c38 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.786293 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-7d84084b-3796-4872-b72d-71f25c557c38 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.478357 Oct 19 13:09:09.786852 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:09:09.810290 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_api:SELECT=14 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:09:09.814121 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-fccd807e-78e4-4797-b409-4be24673f413 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.822173 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-fccd807e-78e4-4797-b409-4be24673f413 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014406 Oct 19 13:09:09.822729 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:09:09.837074 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-91c33436-aab2-44e7-a81f-9b15fee7d47e admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.846942 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-91c33436-aab2-44e7-a81f-9b15fee7d47e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015070 Oct 19 13:09:09.847431 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:09:09.860439 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.868404 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012036 Oct 19 13:09:09.868976 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:09:09.881447 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-10ba2164-5062-4694-980b-f5d31fde8f54 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:09:09.889579 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-10ba2164-5062-4694-980b-f5d31fde8f54 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011768 Oct 19 13:09:09.890128 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Wed Oct 19 13:09:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:12:15.820682 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:15.821765 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 19 13:12:15.822194 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:12:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:12:15.965014 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=6 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:16.164362 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:16.169688 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:16.170164 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:16.170590 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:16.171289 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:16.171729 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:16.172140 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:16.205107 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-2601eac9-01d3-4b6c-95b6-ac62c68e2eee admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.242497 Oct 19 13:12:16.205674 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:12:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:17.300197 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:17.301954 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002548 Oct 19 13:12:17.302654 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:12:17.524755 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:17.528362 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:17.528847 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:17.529289 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:17.530345 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:17.530781 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:17.531188 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:17.550994 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-31e48daa-cb9c-44cf-9560-cb57c9d46d53 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.092529 Oct 19 13:12:17.551436 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:12:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:12:29.082377 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:29.083427 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 19 13:12:29.083831 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:12:29.231234 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_cell0:SELECT=4 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.232200 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_cell1:SELECT=4 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.232893 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG dbcounter [-] [103969] Writing DB stats nova_api:SELECT=8 {{(pid=103969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:12:29.285677 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:29.290998 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:29.291626 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:29.292225 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:29.293396 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:29.293915 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:29.294567 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:29.319705 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-d9031e17-08f4-4ec4-8059-1d3b42e96914 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.095888 Oct 19 13:12:29.320290 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:12:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:12:30.408384 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG nova.api.openstack.wsgi [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] Calling method '>' {{(pid=103970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:30.409441 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: INFO nova.api.openstack.requestlog [None req-61edffb5-5e3d-42e6-913a-fc980adf78a3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 19 13:12:30.409832 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: [pid: 103970|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Oct 19 13:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:12:30.615656 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG nova.api.openstack.wsgi [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Calling method '>' {{(pid=103969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:12:30.619159 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:30.619641 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:30.620087 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:30.620802 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:12:30.621278 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:12:30.621694 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: DEBUG oslo_concurrency.lockutils [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:12:30.643405 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: INFO nova.api.openstack.requestlog [None req-212aa3e9-b75f-4b66-ba1a-981a9840c417 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.094950 Oct 19 13:12:30.644149 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: [pid: 103969|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Oct 19 13:12:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:13:27.849453 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: Wed Oct 19 13:13:27 2022 - graceful shutdown triggered... Oct 19 13:13:27.849450 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 13:13:27.850439 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: Gracefully killing worker 2 (pid: 103970)... Oct 19 13:13:27.851062 dv-cinder-master-3-iscsi devstack@n-api.service[103969]: Gracefully killing worker 1 (pid: 103969)... Oct 19 13:13:27.983276 dv-cinder-master-3-iscsi devstack@n-api.service[103970]: DEBUG dbcounter [-] [103970] Writing DB stats nova_api:SELECT=4 {{(pid=103970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:13:28.850458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: worker 1 buried after 1 seconds Oct 19 13:13:28.850458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: worker 2 buried after 1 seconds Oct 19 13:13:28.850458 dv-cinder-master-3-iscsi devstack@n-api.service[103968]: goodbye to uWSGI. Oct 19 13:13:28.852912 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 19 13:13:28.853800 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 13:13:28.858325 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 13:13:28.874569 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 13:13:28 2022] *** Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: nodename: dv-cinder-master-3-iscsi Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: machine: x86_64 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: clock source: unix Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: pcre jit disabled Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: detected number of CPU cores: 4 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: current working directory: / Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: detected binary path: /usr/bin/uwsgi-core Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: your processes number limit is 47680 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: your memory page size is 4096 bytes Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: detected max file descriptor number: 2048 Oct 19 13:13:28.876891 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: lock engine: pthread robust mutexes Oct 19 13:13:28.877818 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: thunder lock: enabled Oct 19 13:13:28.877818 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 13:13:28.877818 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 13:13:28.919962 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: Python main interpreter initialized at 0x56511a0e59c0 Oct 19 13:13:28.919962 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: python threads support enabled Oct 19 13:13:28.919962 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: your server socket listen backlog is limited to 100 connections Oct 19 13:13:28.919962 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: your mercy for graceful operations on workers is 90 seconds Oct 19 13:13:28.920420 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 13:13:28.920420 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: *** Operational MODE: preforking *** Oct 19 13:13:28.920707 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: *** uWSGI is running in multiple interpreter mode *** Oct 19 13:13:28.920707 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: spawned uWSGI master process (pid: 118960) Oct 19 13:13:28.920953 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 13:13:28.921715 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: spawned uWSGI worker 1 (pid: 118982, cores: 1) Oct 19 13:13:28.923243 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: spawned uWSGI worker 2 (pid: 118983, cores: 1) Oct 19 13:13:28.923243 dv-cinder-master-3-iscsi devstack@n-api.service[118960]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 13:13:29.581968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:13:29.600222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 13:13:30.733944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:13:30.733944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: from cryptography.utils import int_from_bytes Oct 19 13:13:30.734609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:13:30.734609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: from cryptography.utils import int_from_bytes Oct 19 13:13:30.811083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:13:30.811083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: from cryptography.utils import int_from_bytes Oct 19 13:13:30.811700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 13:13:30.811700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: from cryptography.utils import int_from_bytes Oct 19 13:13:33.163583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:13:33.164157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:13:33.164374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:13:33.164735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:13:33.165022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:13:33.165430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.165752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.166071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.166543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.166864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.167241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.167585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.167912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.168280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.168499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.168820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.169179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.169506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.169819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.170133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.170458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.170765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.171089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.171398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.171911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.172370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.172680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.173021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.173610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.173726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.176472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.177225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.177225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.177392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.177589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.177912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.178240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.178551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.178880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.179200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.179524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.179843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.180146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.180458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.180769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.181114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.181439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.181724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.181976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.182284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.182607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.183002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.183405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.183656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.183969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.184322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.184647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.184988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.185301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.185611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.185920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.186229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.186543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.186847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.187162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.187484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.187802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.188128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.188436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.188751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.189197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.189447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.189756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.190102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.190423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.190735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.191063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.191375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.191721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.191985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.192291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.192610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.193152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.193465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.193717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.194021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.194329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.194649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.194958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.195267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.195572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.195872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.196178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.196482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.196994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.197647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.197802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.198116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.198484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.198953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.199575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.200064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.200600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.200977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.201294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.201619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.201924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.202234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.202530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.202841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.203150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.203477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.203787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.204098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.204417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.204728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.205061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.205386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.205690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.205997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.206318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.206627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.206941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.207304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.207558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.207864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.208170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.208476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.208801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.209115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.209441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.209781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.210096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.210398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.210705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.211026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.211367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.211688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.212046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.212363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.212695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.213049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.213372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.213685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.214061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.214417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.214705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.215016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.215328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.215650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.215969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.216299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.216621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.216988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.217289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.217607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.217924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.218255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.218582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.218887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.219235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.219585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.219903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.220231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.220569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.220894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.221217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.221527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.222696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.222696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.222696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.222948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.223117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.223442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.223755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.224068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.224381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.224693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.225087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.225387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.225708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.226034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.226357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.226673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.227001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.227317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.227632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.227949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.228257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.228563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.228922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.229205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.229546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.229907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.230289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.230625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.230964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.231269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.231583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.231895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.232204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.232510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.232821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.233160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.233439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.233779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.234091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.234384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.234713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.235019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.235331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.235664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.235974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.236283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.236599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.237391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.237391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.237566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.237856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.238200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.238539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.238859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.239181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.239497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.239914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.240122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.240438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.240751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.241088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.241392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.241703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.241995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.242315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.242619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.242925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.243226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.243556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.243854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.244175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.244472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.244794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.245210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.245557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.245903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.246239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.246565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.246896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.247207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.247523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.247838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.248141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.248539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.248775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.249163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.249452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.249736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.250064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.250390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.250704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.251018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.251323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.251639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.251981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.252322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.252809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.253162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.253478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.253796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.254107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.254424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.254733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.255047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.255368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.255682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.256004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.256315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.256645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.256992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.257838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.257838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.258170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.258316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.258770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.258929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.259166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.259503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.259804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.260144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.260423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.260723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.261853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.261853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.261853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.262298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.262501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.262755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.263073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.263387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.263696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.264003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.264316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.264740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.264988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.265290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.265614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.265922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.266229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.266558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.266871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.267178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.267485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.267789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.268137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.268448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.268789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.269096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.269419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.269733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.271948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.272246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.272504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.272779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.272952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 13:13:33.273436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.273593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 13:13:33.273735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.273886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 13:13:33.274036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.274036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.274319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 13:13:33.274319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 13:13:33.274818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.274818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.275144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.275287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.276016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.276016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.276331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.276514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.276673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.276853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.277112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.277272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.277422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.277594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.277735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.278362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.278521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.278664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.278991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.279167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.279406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.279562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.279729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.279979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.280128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.280281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.280438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.280588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.280730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.280890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.281087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.281376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.281534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.281684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.281826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.281994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.282244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.282603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.282774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.282774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.283054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.283224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.283380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.283535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.283677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.283817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.283957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.284096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.284236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.284398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.284547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.284689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.284836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.285021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.285165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.285325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.285469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.292498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.293030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.293243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.293446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.293644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.293849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.294029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.294215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.294416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.294593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.294768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.294958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.295135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.295135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.295489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.295667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.295845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.295845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.296200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.296385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.296646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.296646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.297064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.297064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.297356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.297356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.297641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.297790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.297938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.298087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.298241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.298397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.298539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.298687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.298838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.298979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.299128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.299283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.299424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.299574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.299714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.299854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.300012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.300759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.300964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.300964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.301250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.301393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.301533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.301683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.301856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.302558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.302720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.302720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.303224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.303390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.303540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.303692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.303834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.303977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.304132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.304282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.304425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.304567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.304718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.304899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.305063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.305217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.305366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.305515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.305664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.305820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.305962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.306109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.306261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.306403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.306545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.306700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.306842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.306984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.307142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.307284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.307425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.307580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.307767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.307916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.308081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.308287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.308450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.308602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.308602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.308921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.309267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.309430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.315882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.316729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.316964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.317266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.317432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.317602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.317756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.317907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.318051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.318200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.318349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.318521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.318664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.318805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.318953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.319095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.319245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.320024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.320177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.320329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.320471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.320612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.320767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.320954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.321104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.321245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.321386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.321535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.321690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.321840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.321981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.322129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.322271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.322412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.322566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.322720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.322887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.323092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.324087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.324322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.324322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.324713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.324904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.325053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.325215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.325372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.325522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.325663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.325802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.325954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.326103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.326262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.326404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.326552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.326693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.326833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.326980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.327136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.327366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.327521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.327672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.327821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.327983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.328133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.328283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.328484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.328484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.328765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.328937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.328937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.329222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.329375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.329375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.329651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.329799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.329957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.330105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.330256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.330396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.330537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.330676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.330825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.330965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.331114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.331262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.331402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.331542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.331683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.333179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.333368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.333889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.334307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.334457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.334608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.334750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.334902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.335057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.335210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.335358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.335508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.335672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.335824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.335965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.336105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.336253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.336395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.336622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.336774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.336953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.337100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.337241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.337411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.337641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.337808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.337952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.338092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.338239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.338380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.338529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.338678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.338826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.339114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.339349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.339567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.339567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.339845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.340001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.340151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.340299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 13:13:33.340456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.340598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.340746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.340746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.341145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.341446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.341606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.341757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.341908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.342935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.343083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.343285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.343432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.343432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.344395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.344561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.344717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.344892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.345953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.346867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.347011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.347011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.347297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.347449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.350195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.350387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.350552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.350709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.350856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.351858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.352907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.353068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.353233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.353423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.353565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.353721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.354233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.354498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.354758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.354923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.355135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.355316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.355493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.355698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.355855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.356936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.357987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.358718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.359993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.360277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.360425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.360578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.360730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.360902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.361874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.362928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.363867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.364127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.364610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.364720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.364831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.365930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.366969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.367982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.368980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.369937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.370894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.371931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.372917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.373953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.374985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.375944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.376815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.377974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.378927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.379933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.380951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.381983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.382904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.383997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.384947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.385884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.386965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.387929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.388948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.389934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.390939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.391903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.392917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.393993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.394968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.395947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.396972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.397956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.398830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.399833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.400038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.400130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.400353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.400453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.400657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.401890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.402108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.402302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.402435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.402629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.402731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.403295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.403394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.403611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.403757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.403918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.404054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.404226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.404386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.404539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.405932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.406861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.407936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.408851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.409969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.410968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.411995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.412958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.413900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.414952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.415905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.416879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.417959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.418889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.419837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.420774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.421908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.422932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.423889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.424773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.425807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.426943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.427969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.428110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:13:33.428269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.428579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.428916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.429212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.429529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.429824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.430146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.430449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.430750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.431183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.431371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.431696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.431989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.432403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.432799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.433379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.433840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.434157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.434471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.434794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.435119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.435560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.435739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.436053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.436363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.436684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.437031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.437346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.437661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.437964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.438286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.438607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.438922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.439240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.439666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.439981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.440292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.440616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.440966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.441293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.441577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.441919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.442189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.442494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.442816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.443122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.443430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.443739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.444052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.444754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.444754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.444979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.445269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.445667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.445903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.446226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.446550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.446856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.447292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.447486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.447788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.448093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.448516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.449147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.449471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.449822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.450641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.450641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.450843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.451676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.451676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.451841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.452050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.452319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.452646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.452978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.453285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.453597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.453904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.454212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.454516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.454825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.455126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.455432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.455857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.456041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.456347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.456666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.456999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.457303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.457610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.457913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.458255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.458557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.458886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.459195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.459524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.459842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.460157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.460473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.460792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.461131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.461542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.461758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.462069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.462389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.462704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.463021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.463593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.463976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.464555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.465067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.465392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.465711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.466037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.466329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.466644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.466959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.467277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.467608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.467933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.468261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.468598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.468947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.469270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.469588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.469907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.470269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.470583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.470890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.471205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.471521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.471836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.472147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.472457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.472771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.473113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.473429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.473739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.474053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.474368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.474691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.475024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.475345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.475662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.475978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.476292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.476813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.477155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.477488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.477810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.478130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.478448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.478765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.479179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.479494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.480024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.480575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.480924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.481242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.481575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.481894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.482203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.482530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.482846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.483383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.483738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.484057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.484384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.484712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.485054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.485364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.485688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.486011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.486299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.486615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.486928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.487231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.487533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.487848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.488157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.488459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.488772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.489102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.489436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.489742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.490505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO dbcounter [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Registered counter for database nova_api Oct 19 13:13:33.490612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.490612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.490612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.492844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.493174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.493485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.493835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.494148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.494436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.494759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.495064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.495543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.496065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.496496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.496827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.497190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.497507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.497859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.498183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.498753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.499092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.499422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.499759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.500089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.500398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.500707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.501040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.501371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.501689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.502004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.502314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.502627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.502940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.503249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.503561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.503872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.504183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.504510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.504801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.505153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.506312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.506312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.506312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.506791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.506791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.507020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.507978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.507978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.507978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.508379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.508542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.508964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.509200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.509537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.509851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.510165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.510592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.511109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.511245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_db.sqlalchemy.engines [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.511696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.512098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.512411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.512739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.513092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.513410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.513750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.514053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.514384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.514733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.515066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.515389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.515697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.516003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.516309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.516624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.517009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.517263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.517566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.517867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.518179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.518278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writer thread running {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.518485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.518793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.519100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.519402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.519711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.520010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.520311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.520613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.520937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.521242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.521545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.521853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.522160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.522465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.522766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.523068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.523368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.523696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.524026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.524343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.524663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.524995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.525318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.525629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.525949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.526268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.526746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.527257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.527605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.528269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.528587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.528927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.529250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.529564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.529879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.530209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.530539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.530848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.531176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.531498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.531821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.532138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.532451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.532779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.533116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.533430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.533738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.534048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.534358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.534674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.534984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.535296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.535612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.535928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.536250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.536578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.536939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.537272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.537596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.537943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.538255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.538603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.538932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.539255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.539567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.539872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 13:13:33.540115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 13:13:33.575027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.context [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92222fa4-c6fd-435b-a56b-90c4f494d59a(cell1) {{(pid=118982) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:13:33.579567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:13:33.580016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:13:33.581622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:13:33.582362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:13:33.582815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:13:33.584813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:13:33.586868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO dbcounter [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Registered counter for database nova_cell0 Oct 19 13:13:33.591224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO dbcounter [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Registered counter for database nova_cell1 Oct 19 13:13:33.598659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_db.sqlalchemy.engines [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.600899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_db.sqlalchemy.engines [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.602761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO dbcounter [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Registered counter for database nova_api Oct 19 13:13:33.606851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writer thread running {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.608161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writer thread running {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.623758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.630903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writer thread running {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.686947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.context [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),92222fa4-c6fd-435b-a56b-90c4f494d59a(cell1) {{(pid=118983) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 13:13:33.691249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:13:33.691733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:13:33.693318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:13:33.694049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:13:33.694521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:13:33.696538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:13:33.698619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO dbcounter [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Registered counter for database nova_cell0 Oct 19 13:13:33.702710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO dbcounter [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Registered counter for database nova_cell1 Oct 19 13:13:33.710153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.712716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.717180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writer thread running {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.757538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO dbcounter [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Registered counter for database nova_cell0 Oct 19 13:13:33.764791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_db.sqlalchemy.engines [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.769803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writer thread running {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.855358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writer thread running {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:33.865583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO dbcounter [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Registered counter for database nova_cell0 Oct 19 13:13:33.874069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 13:13:33.878642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writer thread running {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 13:13:34.087059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: WARNING keystonemiddleware.auth_token [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:13:34.094732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: WARNING keystonemiddleware.auth_token [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:13:34.196170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: WARNING keystonemiddleware.auth_token [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:13:34.203643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: WARNING keystonemiddleware.auth_token [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:13:34.443161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: WARNING keystonemiddleware.auth_token [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:13:34.449696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: WARNING keystonemiddleware.auth_token [None req-903fbcef-9be1-44ed-a7ec-891316905e98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:13:34.455636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56511a0e59c0 pid: 118982 (default app) Oct 19 13:13:34.548726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: WARNING keystonemiddleware.auth_token [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 13:13:34.554788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: WARNING keystonemiddleware.auth_token [None req-ba8797c0-b0b4-4c3f-832e-aa7708dc9b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 13:13:34.560272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56511a0e59c0 pid: 118983 (default app) Oct 19 13:14:11.189540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.191291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.192653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.193593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.345745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.347689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.348635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:11.354957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:12.918655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-411474e2-d6f3-4517-900d-7e619c580836 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Action: 'create', calling method: .version_select at 0x7ff4fa198b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940765971", "metadata": {"Type": "work"}}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-411474e2-d6f3-4517-900d-7e619c580836 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 121 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:12.926203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940765971", "metadata": {"Type": "work"}}} Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:12.927790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-940765971', 'metadata': {'Type': 'work'}}}} Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise error Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:12.928796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 13:14:12.930420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 13:14:12.931548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 13:14:12.931548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.936479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-411474e2-d6f3-4517-900d-7e619c580836 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:12.937861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-411474e2-d6f3-4517-900d-7e619c580836 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.597459 Oct 19 13:14:12.941005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Oct 19 13:14:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:14:12.953645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a6dd5c1-53ca-4cd7-9f59-dc9bd833f958 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Action: 'create', calling method: .version_select at 0x7ff4fa1b3430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-770097257", "metadata": {"Type": "work"}}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a6dd5c1-53ca-4cd7-9f59-dc9bd833f958 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 119 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:12.960647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-770097257", "metadata": {"Type": "work"}}} Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:12.962088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-770097257', 'metadata': {'Type': 'work'}}}} Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise error Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi '0' Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:12.963103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 13:14:12.964902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 13:14:12.966120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 13:14:12.966120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.969677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a6dd5c1-53ca-4cd7-9f59-dc9bd833f958 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:12.970739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0a6dd5c1-53ca-4cd7-9f59-dc9bd833f958 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023681 Oct 19 13:14:12.973100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Oct 19 13:14:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:14:12.984119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c874e5f-b3d8-41b3-bd79-887a77d42a96 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Action: 'create', calling method: .version_select at 0x7ff4fa052820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153689929", "metadata": {"Type": "work"}}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c874e5f-b3d8-41b3-bd79-887a77d42a96 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 118 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:12.993931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153689929", "metadata": {"Type": "work"}}} Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:12.996068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-153689929', 'metadata': {'Type': 'work'}}}} Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise error Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi '' Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:12.997088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 13:14:12.998660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 13:14:13.000065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 13:14:13.000065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.002455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c874e5f-b3d8-41b3-bd79-887a77d42a96 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:13.004419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2c874e5f-b3d8-41b3-bd79-887a77d42a96 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025588 Oct 19 13:14:13.007406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Oct 19 13:14:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 13:14:13.020220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd247c83-c2a9-4c42-9dbf-9b004b929f33 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Calling method '.version_select at 0x7ff4fa0521f0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:13.127565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-de9fa237-95a6-49a1-81b2-09e38446e4fd tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Action: 'create', calling method: .version_select at 0x7ff4fa196c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-40089665"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:13.595940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-fd247c83-c2a9-4c42-9dbf-9b004b929f33 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] HTTP exception thrown: Volume tempest-invalid-1451878226 could not be found. Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd247c83-c2a9-4c42-9dbf-9b004b929f33 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1451878226 HTTP/1.1 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:13.602001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume tempest-invalid-1451878226 could not be found. Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'tempest-invalid-1451878226'} Oct 19 13:14:13.603749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1451878226 could not be found. (HTTP 404) (Request-ID: req-ada1fa5a-142f-43c2-945f-bd8344cf5477) Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:13.604534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:13.605716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1451878226 could not be found. Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:13.606813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1451878226 could not be found. Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1451878226 could not be found. Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd247c83-c2a9-4c42-9dbf-9b004b929f33 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 404 to user: Volume tempest-invalid-1451878226 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd247c83-c2a9-4c42-9dbf-9b004b929f33 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1451878226" status: 404 len: 99 microversion: 2.1 time: 0.591074 Oct 19 13:14:13.607971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Oct 19 13:14:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1451878226 => generated 99 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 13:14:13.639691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b670e6a-9b49-4d04-8891-21339786c99e tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006943 Oct 19 13:14:13.641739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Oct 19 13:14:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 13:14:13.677939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b25dd024-7467-4d38-b6a9-fa53b0d67688 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015637 Oct 19 13:14:13.678599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Oct 19 13:14:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 13:14:13.690388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f8974f1a-b489-4a82-b01d-ec5ecb689ee8 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Calling method '.version_select at 0x7ff4f9fbd9d0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:14.298125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-f8974f1a-b489-4a82-b01d-ec5ecb689ee8 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] HTTP exception thrown: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f8974f1a-b489-4a82-b01d-ec5ecb689ee8 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/os-volumes/0fe15718-3431-4563-a638-9036570c5192 HTTP/1.1 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:14.300198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '0fe15718-3431-4563-a638-9036570c5192'} Oct 19 13:14:14.301788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. (HTTP 404) (Request-ID: req-bda62402-8014-4b85-9d34-ef68c05d9eab) Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.302694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:14.304097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 13:14:14.307191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f8974f1a-b489-4a82-b01d-ec5ecb689ee8 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 404 to user: Volume 0fe15718-3431-4563-a638-9036570c5192 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f8974f1a-b489-4a82-b01d-ec5ecb689ee8 tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/0fe15718-3431-4563-a638-9036570c5192" status: 404 len: 109 microversion: 2.1 time: 0.619772 Oct 19 13:14:14.317588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:14:13 2022] DELETE /compute/v2.1/os-volumes/0fe15718-3431-4563-a638-9036570c5192 => generated 109 bytes in 625 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:14:14.325131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dc5c50b5-4324-424a-94ad-e936a394884b tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Calling method '.version_select at 0x7ff4f9fbd280>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:14.399878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-de9fa237-95a6-49a1-81b2-09e38446e4fd tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.230446 Oct 19 13:14:14.401220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1/8] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Oct 19 13:14:11 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3233 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 13:14:14.417335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6fc63730-efac-44ba-b28b-b3ed43b777f2 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4fa071a60>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:14.581958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-dc5c50b5-4324-424a-94ad-e936a394884b tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] HTTP exception thrown: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dc5c50b5-4324-424a-94ad-e936a394884b tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Request method failure captured: Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/os-volumes/aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 HTTP/1.1 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjZxe--FYEwOpt1Se0JJAfUXAJsbwXe62cHMl7Q0R-D2lgvImCWhb7zWjU3fBrnydimZQ-tzPBjVkxryyvF01V7Q93RCLplqkYJFNRcztjVmtdhW0V3kgwOxV8saq82MbXDJ0_C4BSmS2jDy6YoKzceK3KCzNP23GclfNAEHMHfsk Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:14.584388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa86444e80774147a6b0d7130a4fbec3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa86444e80774147a6b0d7130a4fbec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: fa86444e80774147a6b0d7130a4fbec3 Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesNegativeTest-407015914 Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 2b6f13b42c1d461e981744bf17599343 Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesNegativeTest-407015914-project Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8'} Oct 19 13:14:14.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. (HTTP 404) (Request-ID: req-60dd7186-ab40-4f6f-9ff7-7fd7c2488625) Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.586820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:14.589009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:14:14.590537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. Oct 19 13:14:14.591903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:14.595051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dc5c50b5-4324-424a-94ad-e936a394884b tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] Returning 404 to user: Volume aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:14.596115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dc5c50b5-4324-424a-94ad-e936a394884b tempest-VolumesNegativeTest-407015914 tempest-VolumesNegativeTest-407015914-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8" status: 404 len: 109 microversion: 2.1 time: 0.275796 Oct 19 13:14:14.597284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 8/9] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:14 2022] GET /compute/v2.1/os-volumes/aecb15cd-8167-4a3d-ad3a-8c22f5bb1ef8 => generated 109 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:14:14.613932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0cb624c6-6827-4100-a7cf-350db6933527 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fbda60>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:14.717883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6fc63730-efac-44ba-b28b-b3ed43b777f2 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 200 len: 343 microversion: 2.1 time: 0.305311 Oct 19 13:14:14.719060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 2/10] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:14 2022] GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 343 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:14.843940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0cb624c6-6827-4100-a7cf-350db6933527 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9d27c6fc-c316-45f5-9a56-78482adeca8e" status: 200 len: 351 microversion: 2.1 time: 0.244710 Oct 19 13:14:14.844528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 9/11] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:14 2022] GET /compute/v2.1/os-volumes/9d27c6fc-c316-45f5-9a56-78482adeca8e => generated 351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:15.733307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ca49d91e-5b8f-4708-82ba-eadf4b50783a tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4fa005160>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:16.081599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ca49d91e-5b8f-4708-82ba-eadf4b50783a tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 200 len: 344 microversion: 2.1 time: 0.352816 Oct 19 13:14:16.082791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 3/12] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:15 2022] GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 344 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:16.097143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-090b176b-eb8a-4520-83c9-0175d1729d90 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Action: 'create', calling method: .version_select at 0x7ff4f9fbd4c0>, body: {"snapshot": {"volume_id": "2935c106-4f28-4ce1-b0f2-7189b883c3a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-132138047"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:16.534312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-090b176b-eb8a-4520-83c9-0175d1729d90 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.442175 Oct 19 13:14:16.534901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 10/13] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Oct 19 13:14:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:16.550624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb46ab52-0781-411a-becd-59f490424a42 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4fa005820>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:16.615249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb46ab52-0781-411a-becd-59f490424a42 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 286 microversion: 2.1 time: 0.071926 Oct 19 13:14:16.615999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 4/14] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:16 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:16.628377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e222a041-e27b-43db-a3d3-805facacbe0e tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9f988b0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:16.708335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-23ff3453-a1db-437d-af03-8435adce27e8 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4fa071c10>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:16.752302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e222a041-e27b-43db-a3d3-805facacbe0e tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.128322 Oct 19 13:14:16.753179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 11/15] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Oct 19 13:14:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:16.766304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a8343e66-7c8c-4f41-b6c7-0b1634b33394 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9f98670>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:16.844010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-23ff3453-a1db-437d-af03-8435adce27e8 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8e2566fc-bf90-4ff2-97e0-c8985f14578b" status: 200 len: 351 microversion: 2.1 time: 0.155617 Oct 19 13:14:16.854614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 5/16] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:16 2022] GET /compute/v2.1/os-volumes/8e2566fc-bf90-4ff2-97e0-c8985f14578b => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:16.930572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a8343e66-7c8c-4f41-b6c7-0b1634b33394 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 286 microversion: 2.1 time: 0.169461 Oct 19 13:14:16.931197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 12/17] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:16 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:17.944479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a26b7de2-f42d-4a5a-9fb7-18e4ef8e1428 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4fa005a60>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:18.024181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a26b7de2-f42d-4a5a-9fb7-18e4ef8e1428 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 286 microversion: 2.1 time: 0.084135 Oct 19 13:14:18.027264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 6/18] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:17 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:19.040119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2a1ed190-095f-435b-bc13-d78270f54dc8 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4fa05d820>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:19.132698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2a1ed190-095f-435b-bc13-d78270f54dc8 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 286 microversion: 2.1 time: 0.097159 Oct 19 13:14:19.138995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 13/19] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:19 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:19.899796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-405400769", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:20.028753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] validate_networks() for [('0b24227a-7c37-40d0-9993-6b37fb855857', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:14:20.146848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-579d3814-46ec-472f-a44a-7f296b8b6726 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fbdca0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:20.228195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-579d3814-46ec-472f-a44a-7f296b8b6726 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 287 microversion: 2.1 time: 0.085547 Oct 19 13:14:20.229259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 14/20] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:20 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:20.241464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-db9c3b7a-3bc0-404c-ad2a-55d03a79cf12 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9f98c10>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:20.406969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-db9c3b7a-3bc0-404c-ad2a-55d03a79cf12 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 202 len: 0 microversion: 2.1 time: 0.169806 Oct 19 13:14:20.411189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 15/21] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Oct 19 13:14:20 2022] DELETE /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:14:20.423185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-27b21919-f20a-4850-8e19-e38f0bd3c5fd tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9f98550>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:20.508342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-27b21919-f20a-4850-8e19-e38f0bd3c5fd tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 200 len: 286 microversion: 2.1 time: 0.092375 Oct 19 13:14:20.509060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 16/22] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:20 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:20.777245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec6f2968-2a88-47f2-bf21-6a0521b9707c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fbd430>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:20.899723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec6f2968-2a88-47f2-bf21-6a0521b9707c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0c3f233a-f30e-467a-a761-606bf17b118c" status: 200 len: 348 microversion: 2.1 time: 0.126832 Oct 19 13:14:20.900318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 17/23] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:20 2022] GET /compute/v2.1/os-volumes/0c3f233a-f30e-467a-a761-606bf17b118c => generated 348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:20.914750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-efea377b-b109-479c-a2f2-a7c20f13c2b3 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fbdaf0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.122098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-efea377b-b109-479c-a2f2-a7c20f13c2b3 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.211522 Oct 19 13:14:21.123157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 18/24] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Oct 19 13:14:20 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:21.138900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af5e5c36-adcd-4646-84f8-d63dbafc2f2c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9f98820>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.249892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af5e5c36-adcd-4646-84f8-d63dbafc2f2c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.115051 Oct 19 13:14:21.251835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 19/25] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:21.268203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3b24708e-32e2-4b89-ae82-ae0c4d40236a tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fa04c0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.375897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3b24708e-32e2-4b89-ae82-ae0c4d40236a tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.112708 Oct 19 13:14:21.377079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 20/26] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:21.390665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-66c52bb4-819a-4b36-9f2d-8019a4108464 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9f9d8b0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.514846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-66c52bb4-819a-4b36-9f2d-8019a4108464 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.128446 Oct 19 13:14:21.516324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 21/27] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:21.530186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-88060de3-f3a5-4a8c-a110-07832bc15ac9 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fa0310>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.596173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-88060de3-f3a5-4a8c-a110-07832bc15ac9 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] HTTP exception thrown: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-88060de3-f3a5-4a8c-a110-07832bc15ac9 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Request method failure captured: Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 HTTP/1.1 Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjgSgwJdgkL8NJnfJDGMBk5AAqLrrC9_Dkmda24jATWdE8tLMfhDOnd-AFIQNFLBkIt6mhDgipOXmVSUqeOPk4T4UeVkucesJPom_usvd4DEZdbxCOxXknV5rjLeW_MiE44UTHMhxtJJpswmYfvX0j0DQaDX-yRHBKP0h5ntLf7pU Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:21.598666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091c61402d44ecfb21eb58ef489b89b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: fb4067c707b949fe80123ce8419172cb Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '2cdd0f04-341f-4d06-9465-e80392528337'} Oct 19 13:14:21.600251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. (HTTP 404) (Request-ID: req-fbcc8307-3965-44b6-b9d9-0993d5d4d0b0) Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:21.602583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 13:14:21.604669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-88060de3-f3a5-4a8c-a110-07832bc15ac9 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Returning 404 to user: Snapshot 2cdd0f04-341f-4d06-9465-e80392528337 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:21.606728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-88060de3-f3a5-4a8c-a110-07832bc15ac9 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337" status: 404 len: 111 microversion: 2.1 time: 0.081480 Oct 19 13:14:21.607736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 22/28] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-snapshots/2cdd0f04-341f-4d06-9465-e80392528337 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:14:21.611098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b1666730-5776-477f-b714-c6218270693c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9f98ee0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.765427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b1666730-5776-477f-b714-c6218270693c tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.158079 Oct 19 13:14:21.766522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 23/29] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:21.771111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e64fa6aa-cfb4-401f-94d9-695c684e2fe8 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fa0160>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:21.895941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e64fa6aa-cfb4-401f-94d9-695c684e2fe8 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 202 len: 0 microversion: 2.1 time: 0.128340 Oct 19 13:14:21.896788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 24/30] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:14:21 2022] DELETE /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:14:21.902950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-100255b6-76ff-492e-b029-f146333b332f tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fa0820>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.075716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-100255b6-76ff-492e-b029-f146333b332f tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.177466 Oct 19 13:14:22.076510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 25/31] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Oct 19 13:14:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:22.082250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0f3a2a2a-84ed-413e-9033-3f1374f66cf1 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fac670>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.138079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-0f3a2a2a-84ed-413e-9033-3f1374f66cf1 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] HTTP exception thrown: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0f3a2a2a-84ed-413e-9033-3f1374f66cf1 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Request method failure captured: Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 HTTP/1.1 Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjgSgwJdgkL8NJnfJDGMBk5AAqLrrC9_Dkmda24jATWdE8tLMfhDOnd-AFIQNFLBkIt6mhDgipOXmVSUqeOPk4T4UeVkucesJPom_usvd4DEZdbxCOxXknV5rjLeW_MiE44UTHMhxtJJpswmYfvX0j0DQaDX-yRHBKP0h5ntLf7pU Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:22.141040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091c61402d44ecfb21eb58ef489b89b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: fb4067c707b949fe80123ce8419172cb Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '2935c106-4f28-4ce1-b0f2-7189b883c3a1'} Oct 19 13:14:22.142403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. (HTTP 404) (Request-ID: req-ebc5b33b-e976-4f2b-9635-55232bca2a51) Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.143189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:22.144301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:14:22.146765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.149307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.159683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0f3a2a2a-84ed-413e-9033-3f1374f66cf1 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Returning 404 to user: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:22.161518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0f3a2a2a-84ed-413e-9033-3f1374f66cf1 tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 404 len: 109 microversion: 2.1 time: 0.083558 Oct 19 13:14:22.163466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 26/32] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:22 2022] GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:14:22.171569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78fb589c-7a9d-46e8-858d-c23029bc3cc7 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9f9daf0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.341955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78fb589c-7a9d-46e8-858d-c23029bc3cc7 tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.177055 Oct 19 13:14:22.342614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 27/33] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Oct 19 13:14:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:22.350634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c423997-9811-470c-aa1f-021025f4668c tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fac9d0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.402741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-3c423997-9811-470c-aa1f-021025f4668c tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] HTTP exception thrown: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c423997-9811-470c-aa1f-021025f4668c tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Request method failure captured: Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 HTTP/1.1 Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjgSgwJdgkL8NJnfJDGMBk5AAqLrrC9_Dkmda24jATWdE8tLMfhDOnd-AFIQNFLBkIt6mhDgipOXmVSUqeOPk4T4UeVkucesJPom_usvd4DEZdbxCOxXknV5rjLeW_MiE44UTHMhxtJJpswmYfvX0j0DQaDX-yRHBKP0h5ntLf7pU Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:22.405379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091c61402d44ecfb21eb58ef489b89b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: fb4067c707b949fe80123ce8419172cb Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '2935c106-4f28-4ce1-b0f2-7189b883c3a1'} Oct 19 13:14:22.406857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. (HTTP 404) (Request-ID: req-22e11e15-8114-4b73-96e1-a82e034db565) Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.407617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 13:14:22.411971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 13:14:22.415135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c423997-9811-470c-aa1f-021025f4668c tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Returning 404 to user: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c423997-9811-470c-aa1f-021025f4668c tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 404 len: 109 microversion: 2.1 time: 0.062926 Oct 19 13:14:22.416497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 28/34] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:14:22 2022] DELETE /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:14:22.417636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-80b4b362-7b9f-486c-8905-e2a92ff4597d tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] Calling method '.version_select at 0x7ff4f9fa0790>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.570538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-80b4b362-7b9f-486c-8905-e2a92ff4597d tempest-VolumesTestJSON-1384670904 tempest-VolumesTestJSON-1384670904-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.160351 Oct 19 13:14:22.571136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 29/35] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Oct 19 13:14:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:22.577854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a3a0a878-2160-446b-a9e9-5001b64db6ac tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Calling method '.version_select at 0x7ff4f9fac4c0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:22.682638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-a3a0a878-2160-446b-a9e9-5001b64db6ac tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] HTTP exception thrown: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a3a0a878-2160-446b-a9e9-5001b64db6ac tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Request method failure captured: Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 HTTP/1.1 Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gjgSgwJdgkL8NJnfJDGMBk5AAqLrrC9_Dkmda24jATWdE8tLMfhDOnd-AFIQNFLBkIt6mhDgipOXmVSUqeOPk4T4UeVkucesJPom_usvd4DEZdbxCOxXknV5rjLeW_MiE44UTHMhxtJJpswmYfvX0j0DQaDX-yRHBKP0h5ntLf7pU Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:14:22.685203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b091c61402d44ecfb21eb58ef489b89b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b091c61402d44ecfb21eb58ef489b89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: b091c61402d44ecfb21eb58ef489b89b Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1881538137 Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: fb4067c707b949fe80123ce8419172cb Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1881538137-project Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '2935c106-4f28-4ce1-b0f2-7189b883c3a1'} Oct 19 13:14:22.686748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. (HTTP 404) (Request-ID: req-aa46e843-9cb8-4b68-b389-5c759a87c954) Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.687759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:14:22.689115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:14:22.690477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. Oct 19 13:14:22.691883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:14:22.695062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a3a0a878-2160-446b-a9e9-5001b64db6ac tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] Returning 404 to user: Volume 2935c106-4f28-4ce1-b0f2-7189b883c3a1 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:14:22.696109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a3a0a878-2160-446b-a9e9-5001b64db6ac tempest-VolumesSnapshotsTestJSON-1881538137 tempest-VolumesSnapshotsTestJSON-1881538137-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1" status: 404 len: 109 microversion: 2.1 time: 0.123209 Oct 19 13:14:22.700391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 30/36] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:14:22 2022] GET /compute/v2.1/os-volumes/2935c106-4f28-4ce1-b0f2-7189b883c3a1 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:14:22.780375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:14:22.781747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:14:22.782623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:14:22.783830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:14:22.783962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:14:22.825873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:22.826719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:22.827409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:22.828398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:22.829118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:22.829721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:22.919970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:14:22.936457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for user f71530099a11440b9d69f550286d9614 and project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:14:22.961650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:14:22.965843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:14:23.109556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ac2fcb1-b105-4167-acf2-6d06d1964afa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.546699 Oct 19 13:14:23.112123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 7/37] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:14:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:14:23.124426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b3dc4cf2-1b1b-4b75-a738-29a5d07e7b6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:23.125230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b3dc4cf2-1b1b-4b75-a738-29a5d07e7b6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:23.492676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b3dc4cf2-1b1b-4b75-a738-29a5d07e7b6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:23.552074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b3dc4cf2-1b1b-4b75-a738-29a5d07e7b6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1221 microversion: 2.1 time: 0.431672 Oct 19 13:14:23.585461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 31/38] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:23 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:23.903008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1901967925", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:24.013033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] validate_networks() for [('0b24227a-7c37-40d0-9993-6b37fb855857', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:14:24.978867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:14:24.979553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:14:24.980069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:14:24.980554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:14:24.981088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:14:25.005291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:25.007963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:25.015331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:25.016390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:25.017091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:25.017789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:25.085356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:14:25.098462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for user f71530099a11440b9d69f550286d9614 and project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:14:25.141752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:14:25.145506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:14:25.268743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd31ebc0-2472-4615-83b0-3a7680bb9a4c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.374367 Oct 19 13:14:25.272289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 8/39] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:14:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:14:25.282100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b02a3c98-7a76-47a1-8316-003283d551e6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:25.282564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b02a3c98-7a76-47a1-8316-003283d551e6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:25.439194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b02a3c98-7a76-47a1-8316-003283d551e6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:25.450866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b02a3c98-7a76-47a1-8316-003283d551e6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1222 microversion: 2.1 time: 0.171295 Oct 19 13:14:25.454195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 32/40] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:25 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:26.484845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86330dd7-6736-4960-ac37-1cbc8638763a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:26.485827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86330dd7-6736-4960-ac37-1cbc8638763a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:26.721631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86330dd7-6736-4960-ac37-1cbc8638763a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:26.771872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86330dd7-6736-4960-ac37-1cbc8638763a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1222 microversion: 2.1 time: 0.290013 Oct 19 13:14:26.774670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 9/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:26 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:27.815462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:27.816811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:27.838775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:27.839775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:27.840457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:27.842243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:27.842907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:27.843617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:28.089125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:28.102282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dbcbc2e8-5c39-4737-bc62-2e3290a6f784 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1226 microversion: 2.1 time: 0.297547 Oct 19 13:14:28.103215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 10/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:27 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1226 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:28.329375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3ceb6cbf-9855-410d-b262-01daf0907ef5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'create', calling method: .version_select at 0x7ff4f9fac670>, body: {"keypair": {"name": "tempest-keypair-404079147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0SfccgkhAEHekCMqX/2gPS7s7O1H4pzSNqGoPG8bCeEKNI21W10X+9+5sj6JvMJtgZ1kCKBiYpVO0uNuFztVJcDdkLMUjOXSv4FbdPIS2i9Nf2MGJPg3UgZDvKSHgLTg=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:28.446057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-3ceb6cbf-9855-410d-b262-01daf0907ef5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for project 0a5888bfc20042a791f6798975b860fd. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:14:28.486869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-3ceb6cbf-9855-410d-b262-01daf0907ef5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for user 7e6d95493f8e4b58a9a212999916e6b1 and project 0a5888bfc20042a791f6798975b860fd. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:14:28.616636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3ceb6cbf-9855-410d-b262-01daf0907ef5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.932390 Oct 19 13:14:28.617869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 33/43] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Oct 19 13:14:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 934 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 19 13:14:29.133736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:29.145275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:29.155641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:29.156359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:29.156984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:29.157856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:29.162479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:29.163771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:29.516305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:29.545361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-862e0ca3-905c-4ad7-838e-89a6bd261a18 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1274 microversion: 2.1 time: 0.422664 Oct 19 13:14:29.546608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 34/44] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:29 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1274 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:29.957593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-314850317", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "networks": [{"uuid": "54331213-d392-4b65-b6b0-c5dd5b54a015"}]}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:30.131387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] validate_networks() for [('54331213-d392-4b65-b6b0-c5dd5b54a015', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:14:30.572197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:30.572955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:30.582788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:30.584057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:30.586443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:30.587294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:30.589838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:30.590538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:31.030856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:31.042782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c207e09-9be2-44fb-8eba-809efed9332d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1280 microversion: 2.1 time: 0.474849 Oct 19 13:14:31.043645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 35/45] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:30 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:32.070485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:32.071866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:32.084331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:32.085112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:32.085725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:32.086591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:32.087184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:32.087795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:32.322789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:32.336193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-194980cb-dc2b-4ca2-87e3-a008edbb3fa6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1280 microversion: 2.1 time: 0.265211 Oct 19 13:14:32.337071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 36/46] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:32 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:32.731729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:14:32.732340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:14:32.732852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:14:32.733078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:14:32.733545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:14:32.777751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:32.778564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:32.779177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:32.781359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:32.784002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:32.785429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:32.868426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Getting quotas for project e2c1c4c6f41f4241b86f3b3e6bb2847c. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:14:32.880226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Getting quotas for user abf61dfe9e94487195fd684a1c96dff6 and project e2c1c4c6f41f4241b86f3b3e6bb2847c. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:14:32.907889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:14:32.910356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:14:33.055216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b234863-6cb9-48ea-a418-4de9ac512631 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.926406 Oct 19 13:14:33.057325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 11/47] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:14:33.069821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb9df651-643f-47e7-af24-0cbad82abfc3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:33.070697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb9df651-643f-47e7-af24-0cbad82abfc3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:33.361144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:33.362594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:33.386602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:33.387413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:33.390185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:33.392996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:33.393702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:33.394357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:33.887373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:33.899890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e6d7f581-abba-446d-aa96-42817ee62a38 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1280 microversion: 2.1 time: 0.540889 Oct 19 13:14:33.903049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 12/48] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:33 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1280 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:33.981003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb9df651-643f-47e7-af24-0cbad82abfc3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:33.992531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb9df651-643f-47e7-af24-0cbad82abfc3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1214 microversion: 2.1 time: 0.926730 Oct 19 13:14:33.995915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 37/49] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:33 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1214 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:34.933675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:34.936533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:34.960905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:34.967431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:34.968355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:34.972041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:34.975710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:34.976504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:35.024498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:35.027191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:35.065863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:35.067508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:35.072449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:35.076707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:35.077462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:35.078688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:35.356898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:35.373195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cd49bf0e-2705-4ee0-b55f-d0377edc9123 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1266 microversion: 2.1 time: 0.354625 Oct 19 13:14:35.392826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 38/50] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:35 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:36.417077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:36.417725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:36.425584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:36.426075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:36.435634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:36.441701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:36.445467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:36.448904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:37.166628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:37.201306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6995277d-34bc-4163-8a35-0386a07104ca tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1272 microversion: 2.1 time: 0.786285 Oct 19 13:14:37.204309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 39/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:36 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1272 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:38.231831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:38.232739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:38.251732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:38.253877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:38.257141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:38.259426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:38.261346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:38.263995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:38.409498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:38.431979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-10952a6f-c0a0-49ea-ade4-744913576ce4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 3.498544 Oct 19 13:14:38.434487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 13/52] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:34 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 3512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:38.653799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1203409209", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fcb8410-cf5e-404e-8684-2e02d81730af"}], "security_groups": [{"name": "tempest-securitygroup--893562449"}], "key_name": "tempest-keypair-404079147", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:38.669257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:38.689039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-419bf419-e7f6-424a-b244-1e4864f0b0d1 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1272 microversion: 2.1 time: 0.461039 Oct 19 13:14:38.691709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 40/53] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:38 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1272 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:39.172009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] validate_networks() for [('5fcb8410-cf5e-404e-8684-2e02d81730af', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:14:39.472472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:39.480953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:39.511594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:39.518547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:39.519760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:39.520695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:39.521665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:39.535191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:40.927810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:40.942378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b03c0681-1f94-4dcf-b572-f848847b75a1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 1.473762 Oct 19 13:14:40.943056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 41/54] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:39 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:40.951265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:40.952155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:40.967687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:40.969380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:40.973988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:40.975119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:40.977753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:40.979187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:41.920205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:41.937071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c0f2a76f-94ab-4d9c-b7c5-4ee321fc29e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.992761 Oct 19 13:14:41.942391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 42/55] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:40 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:42.424930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:14:42.426149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:14:42.427056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:14:42.427607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:14:42.428155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:14:42.430558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:42.458701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.461472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.462133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.463220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.469455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.470058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.543431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for project 0a5888bfc20042a791f6798975b860fd. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:14:42.555350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for user 7e6d95493f8e4b58a9a212999916e6b1 and project 0a5888bfc20042a791f6798975b860fd. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:14:42.585583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6097802-0b69-4ef8-86d2-69b057ba2303", "tag": "1432a9c6-8c6c-4dab-b3f2-84ff265ba930"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:42.586551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:14:42.588791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:14:42.630469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.633623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.637451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.741513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Creating event network-changed:1432a9c6-8c6c-4dab-b3f2-84ff265ba930 for instance e6097802-0b69-4ef8-86d2-69b057ba2303 on hv-cinder-maste Oct 19 13:14:42.742054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 13:14:42.742443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fdb6d81d-4dfb-41ae-8b40-fcbd98f39921 req-a111ec7f-f64a-4ff6-99e7-250d58badf05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 13:14:42.753671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-392c10f4-252d-4d0d-97ed-9c2f0ae75ca3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.106439 Oct 19 13:14:42.755885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.756452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.756944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.757724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.759004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 14/56] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Oct 19 13:14:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 4113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 19 13:14:42.771210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.773222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.783469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:42.786389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:42.822808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.823322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.826761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.compute.rpcapi [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 13:14:42.828078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.828395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] Releasing lock "compute-rpcapi-router" {{(pid=118983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 13:14:42.830221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:42.830825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:42.831345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:42.891065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7559a195-f067-414f-b170-7f8903d88d07 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.941973 Oct 19 13:14:42.892026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 43/57] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:42.900578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:42.920412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:43.169947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:43.191622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:43.206893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:43.208505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b075f04-6424-4f24-afee-e40b68a9d521 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1281 microversion: 2.20 time: 0.312235 Oct 19 13:14:43.242434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 44/58] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1281 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:43.259055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:43.272900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:43.296581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:43.297122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:43.297559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:43.298280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:43.305688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:43.306247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:43.854396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:43.867942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-19a4b8d9-661b-44ff-98f8-71835c159d5c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.623154 Oct 19 13:14:43.870687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 45/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:43 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:44.032390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d2c13-c71c-4471-b5a4-0b9ea8898613", "tag": "b55d3193-1cb5-4953-a286-2a0c4f3d5d2e"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:44.053218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:44.053528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:44.053961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:44.113124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] Creating event network-changed:b55d3193-1cb5-4953-a286-2a0c4f3d5d2e for instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 on hv-cinder-maste Oct 19 13:14:44.132370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-8eeabd84-2844-45bf-b35f-8c88ad8fc39a req-e806d202-5173-4b6e-b7fc-5b2123145033 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258743 Oct 19 13:14:44.138058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 46/60] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:44.212488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:44.238800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00472b3d-78a9-46cf-af1f-fa212f05e1c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 1.467364 Oct 19 13:14:44.239901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 15/61] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:42 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:44.242106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:44.243058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:44.259518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:44.262379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:44.264301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:44.267551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:44.268332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:44.269703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:44.518228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:44.567857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:44.579374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:44.586503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c71537a-4cf2-47dc-bd6f-82339bd2c31d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1277 microversion: 2.20 time: 0.350314 Oct 19 13:14:44.595191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 47/62] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:44.892705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:44.893676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:44.905690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:44.908155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:44.911631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:44.914154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:44.915060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:44.915919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.197673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f9160b-f332-4198-a36f-4ad52beca5db", "tag": "ceb464db-4cbb-4a17-b5fb-9939a603d6d3"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:45.220760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:45.221503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:45.221886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.252815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] Creating event network-changed:ceb464db-4cbb-4a17-b5fb-9939a603d6d3 for instance 89f9160b-f332-4198-a36f-4ad52beca5db on hv-cinder-maste Oct 19 13:14:45.262307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-ab1fd9b9-f70c-410f-a2e6-22ebf6cf2413 req-0ef230c8-5a35-46d7-872e-f527a4443c7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068142 Oct 19 13:14:45.262993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 48/63] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:45.268736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:45.269593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:45.276547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:45.277070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:45.277493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.278186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:45.278629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:45.279041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.338006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:45.350374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-58bba8cc-3d5e-44f9-8dc6-36303129da75 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.462015 Oct 19 13:14:45.361018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 16/64] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:44 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:45.556977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:45.562332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e1b7186a-3d8a-461d-a497-685b7870807f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.297704 Oct 19 13:14:45.563232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 49/65] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:45 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:45.626962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:45.631939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:45.645746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:45.651489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:45.652804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.655279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:45.655874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:45.656169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:45.776633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:45.786232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:45.787941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:45.789163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ccba0b8e-b220-4fe3-b046-0f11f7cb43c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1333 microversion: 2.20 time: 0.167496 Oct 19 13:14:45.790043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 17/66] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:46.375501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:46.376107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:46.382961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.383446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.383876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.384828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.385321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.389173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.528589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:46.537685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8bf8bef5-f05c-45de-ae6c-465a34d49eba tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.165935 Oct 19 13:14:46.538432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 50/67] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:46 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:46.591302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:46.592089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:46.605957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.606450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.606884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.611819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.612302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.612742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.792542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:46.801093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2373403-dba0-433a-b683-7090bd5d4e2c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.218338 Oct 19 13:14:46.805708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 18/68] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:46 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:46.816073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:46.816693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:46.824578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.825971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.827250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.828791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:46.829429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:46.829999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:46.907597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:46.916506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:46.918503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:46.919816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-36aa9e85-1941-49f3-bb4c-5183c8211c6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1333 microversion: 2.20 time: 0.108266 Oct 19 13:14:46.920922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 51/69] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:14:47.559883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:47.561391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:47.571678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.572102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.572701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:47.582967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.583650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.583911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:47.756677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:47.766050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-028a4215-31cd-442b-b6df-96723de4acd2 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.210253 Oct 19 13:14:47.766801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 19/70] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:47 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:47.827328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:47.827936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:47.834358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.835020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.835455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:47.836153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.836752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.837276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:47.944282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:47.945167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:47.957592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.958084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.959335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:47.960345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:47.960820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:47.961259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:48.047378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:48.057545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:48.059374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:48.060539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-60b81811-b911-4fd0-a5ae-e2f1a92ae705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1333 microversion: 2.20 time: 0.120232 Oct 19 13:14:48.061461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 20/71] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:48.233248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:48.242215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-84abf220-3c56-4bef-a642-5cc31fc4f8aa tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.418980 Oct 19 13:14:48.243828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 52/72] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:47 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:48.791993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:48.793340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:48.800460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:48.800975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:48.801736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:48.802481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:48.803071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:48.803489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:48.952811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:48.963268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8feb2eee-e4c0-4644-ad05-c789c20cfaab tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.176478 Oct 19 13:14:48.964021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 21/73] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:48 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:49.085466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:49.086086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:49.092602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:49.093156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:49.093589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:49.094279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:49.094723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:49.095139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:49.158620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:49.171571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:49.173976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:49.175866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8036cb50-0aae-4a67-9e22-2ae189f1973e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1333 microversion: 2.20 time: 0.093955 Oct 19 13:14:49.176639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 53/74] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:49.266838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:49.267509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:49.274654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:49.275821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:49.276661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:49.277458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:49.277956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:49.278415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:49.418306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:49.426693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-90c7298b-7af9-49b6-a23b-e1d212d90960 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.164049 Oct 19 13:14:49.427175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 22/75] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:49 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:50.006130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:50.008043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:50.028591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.030813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.031322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.032248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.036487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.037213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.063920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:50.204475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:50.205205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:50.218592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.219509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.220082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.221377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.221957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.222396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.312906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:50.322210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:50.323722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:50.325209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0ef1a3c3-7be0-40b1-aa99-a63e0c683c7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1339 microversion: 2.20 time: 0.126012 Oct 19 13:14:50.326615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 23/76] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1339 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:50.425992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:50.434723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01cc7fdb-9dae-46a1-8951-b5e62340bf50 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.448994 Oct 19 13:14:50.435304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 54/77] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:49 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:50.449894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:50.450679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:50.457246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.457767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.458173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.458865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:50.459299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:50.459719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:50.592465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:50.600175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-52a891b9-7388-4506-8aa9-ada0a2121330 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.154299 Oct 19 13:14:50.605211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 24/78] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:50 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:51.352948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:51.353534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:51.361987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.362466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.362893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.363577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.364020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.364436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.428432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:51.437139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:51.438599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:51.439679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5f4912d-b868-495e-aa92-d8b4aaba24b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1339 microversion: 2.20 time: 0.090760 Oct 19 13:14:51.440395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 55/79] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:51.458813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:51.459411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:51.465941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.466415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.466937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.467626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.468080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.468468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.471182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=87 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:51.604000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:51.611909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00798565-d1a6-4200-85ec-372890d7f1db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.156966 Oct 19 13:14:51.612497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 25/80] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:51 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:51.622967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:51.623595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:51.625506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:51.630902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.631384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.631815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.632504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:51.632990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:51.633407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:51.771858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:51.780709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aa0a9688-ad5e-443b-b69d-c394f6775124 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.161627 Oct 19 13:14:51.781258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 56/81] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:51 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:52.466028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:52.466849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:52.475177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.475884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.476347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.477333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.478017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.478386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.507640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=8 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:52.554330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:52.564180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:52.565672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:52.566850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1d9a589f-a85d-460a-954d-33588c13ead1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1339 microversion: 2.20 time: 0.106305 Oct 19 13:14:52.567338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 26/82] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:52.635239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:52.635860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:52.642086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.642566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.642999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.643678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.644129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.644543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.777643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:52.785646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-76e31b2a-7880-452a-a4e5-901c97819c2c tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.154926 Oct 19 13:14:52.786220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 57/83] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:52 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:52.803650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:52.804293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:52.806261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=26 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:52.812049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.812528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.813019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.813711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:52.814169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:52.814586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:52.951576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:52.959692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b6f5a70e-8786-48e0-9de6-12fb27a348c9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.159942 Oct 19 13:14:52.960275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 27/84] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:52 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:53.592407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:53.593048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:53.601197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:53.601197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=12 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:14:53.601197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:53.601636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:53.602237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:53.603133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:53.603607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:53.604393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:53.679498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:53.708385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:53.709877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:53.711260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e59f4cac-a914-438a-9c9a-c9717bd15976 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1339 microversion: 2.20 time: 0.123220 Oct 19 13:14:53.711817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 58/85] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:53.810254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:53.813631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:53.821946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:53.823713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:53.824522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:53.825720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:53.826437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:53.827118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:53.983189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:53.983803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:53.999063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:53.999551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:53.999983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:54.000705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:54.001490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:54.012827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:54.155416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:54.169644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-751f548d-d6f8-46d4-98f1-c31fc4cbaa7d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.365721 Oct 19 13:14:54.181145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 28/86] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:53 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:54.449461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:54.457745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd39dc03-e416-455f-bcdd-e2b7c76f9f28 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.478912 Oct 19 13:14:54.458610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 59/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:53 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:54.739298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:54.739911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:54.746716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:54.747428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:54.748085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:54.748850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:54.749391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:54.749878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:54.894701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:54.904444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:54.905931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:54.907316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-744ccd42-8fee-4405-b932-b0cf91d5c8d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.173013 Oct 19 13:14:54.924907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 29/88] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:55.195191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:55.195804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:55.202498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.202917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.203352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:55.204037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.204505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.204924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:55.344605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:55.353020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e83d122f-ef01-41f6-b544-adf9507789cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.161666 Oct 19 13:14:55.353682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 60/89] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:55 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:55.483954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:55.484555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:55.490750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.491225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.491650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:55.492365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.492812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.493255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:55.624594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:55.632256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-df3abe26-b35b-48db-965d-702ecda17ddb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.152385 Oct 19 13:14:55.632774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 30/90] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:55 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:55.932244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:55.932846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:55.940240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.940726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.941210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:55.941899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:55.942352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:55.942781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:56.085200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:56.093729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:56.095195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:56.096311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3ab784b3-c56e-478b-b875-010fa215ebae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.168315 Oct 19 13:14:56.096879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 61/91] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:56.375702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:56.376303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:56.382885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:56.383357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:56.383783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:56.384453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:56.385020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:56.385446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:56.529333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:56.537688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7c4892a4-ee34-419f-b3c1-77d023c479db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.165747 Oct 19 13:14:56.538275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 31/92] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:56 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:56.655419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:56.656099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:56.663157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:56.663634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:56.664062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:56.664963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:56.665325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:56.665737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:56.863647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:56.873858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1226b0c1-cbd0-4ef6-a3a8-a7efd87321df tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.222167 Oct 19 13:14:56.874441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 62/93] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:56 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:57.127097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:57.128093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:57.140461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.141663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.143069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.145222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.145891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.146420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.325650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:57.335729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:57.338177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:57.339647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-53da60d8-fcbe-4fce-b1f3-f894d42e1ec0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.219957 Oct 19 13:14:57.340720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 32/94] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:57.561499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:57.562038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:57.570395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.573056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.574583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.575579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.576582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.578458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.585406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6097802-0b69-4ef8-86d2-69b057ba2303", "name": "network-vif-plugged", "status": "completed", "tag": "1432a9c6-8c6c-4dab-b3f2-84ff265ba930"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:57.598718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.599280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.599778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.622801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] Creating event network-vif-plugged:1432a9c6-8c6c-4dab-b3f2-84ff265ba930 for instance e6097802-0b69-4ef8-86d2-69b057ba2303 on hv-cinder-maste Oct 19 13:14:57.637942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-7cce4116-a96d-4468-9e8a-460309170c2d req-9f062659-8264-49d6-9a43-65fc6f1b33f1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135271 Oct 19 13:14:57.639035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 63/95] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:14:57.740149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:57.748760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-40eab482-f893-4d64-8da2-894d0d434b48 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.191248 Oct 19 13:14:57.749826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 33/96] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:57 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:57.885673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:57.899702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:57.900301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:57.905726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.906174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.908898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.913163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.913640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.914064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.914772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:57.915221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:57.915633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:57.941340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] Creating event network-changed:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:14:57.946566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-9adcc2e1-2f91-4cfb-8f82-b61c776457f2 req-b08fecc3-1b2e-40ed-8276-8101781a2bc0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065320 Oct 19 13:14:57.947164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 64/97] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:58.062218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:58.070566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab0ac5d0-a581-46d7-a9d0-b37ae6bda228 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.174939 Oct 19 13:14:58.071174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 34/98] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:57 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:14:58.371180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:58.372346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:58.383091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:58.383881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:58.384794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:58.385978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:58.386627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:58.387046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:58.523022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:58.531582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:58.533121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:58.534238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e43cda46-912e-4e69-8ea6-eedbbafcaa81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.170368 Oct 19 13:14:58.534781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 65/99] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:58.777654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:58.778285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:58.785670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:58.786138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:58.786583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:58.787282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:58.787716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:58.788131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:58.920394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:58.928540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-11be82b1-b0aa-48f6-acbb-809cc6928a20 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.158670 Oct 19 13:14:58.929139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 35/100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:58 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:59.096231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:59.096906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:59.105963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.106445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.106884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.107571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.108029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.108454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.249129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:59.257102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-70fdccfc-555f-4e12-b626-91368be4852f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.166828 Oct 19 13:14:59.257699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 66/101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:59 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:14:59.558908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:59.559506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:59.566040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.566574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.566997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.567706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.568149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.568558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.661574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2c13-c71c-4471-b5a4-0b9ea8898613", "name": "network-vif-plugged", "status": "completed", "tag": "b55d3193-1cb5-4953-a286-2a0c4f3d5d2e"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:14:59.671695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.672165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.672586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.685174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] Creating event network-vif-plugged:b55d3193-1cb5-4953-a286-2a0c4f3d5d2e for instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 on hv-cinder-maste Oct 19 13:14:59.690159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-b6448801-41c0-49e9-bee5-0958e3960176 req-14c1330c-b7d6-440e-b8c6-ce0374de79b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 Oct 19 13:14:59.690787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 67/102] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:14:59.707791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:59.722054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:59.723515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:14:59.724735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-32bfc202-f9cc-40ed-9d28-7c37ebf6cf69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.169811 Oct 19 13:14:59.725344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 36/103] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:14:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:14:59.958180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:14:59.959616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:14:59.973956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.977065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.977763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:14:59.978567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:14:59.978994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:14:59.979430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:00.280352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:00.280972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:00.287237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:00.287701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:00.288142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:00.288812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:00.290913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:00.291318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:00.361535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:00.372832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f47fb3d9-ad24-44d0-9946-ef34bc62aba4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.424820 Oct 19 13:15:00.373808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 68/104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:14:59 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:15:00.450594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:00.458854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-97e8d523-fc5f-40e3-a3f9-d520788f2fb0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.182890 Oct 19 13:15:00.459458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 37/105] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:00 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:00.751668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:00.752508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:00.758676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:00.759166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:00.759653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:00.760285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:00.760734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:00.761396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:00.900157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:00.908738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:00.911212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:00.911401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-18d787e0-7fc3-49c3-b3b1-3bd331850361 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.163650 Oct 19 13:15:00.912062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 69/106] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:01.396466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:01.397015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:01.403811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.404293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.404722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:01.405436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.405885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.406300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:01.489350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:01.489964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:01.496286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.496778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.497258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:01.497970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.498427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.498851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:01.541351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:01.549355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e315bf5f-73e3-4251-a99c-022f31c49c25 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.156828 Oct 19 13:15:01.549932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 38/107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:01 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:01.630280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:01.638433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e334c055-e205-4447-a4d8-7fe6270d1c4a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.152944 Oct 19 13:15:01.639012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 70/108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:01 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:01.935863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:01.936455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:01.943117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.943631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.944064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:01.944754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:01.945243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:01.945665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:02.074999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:02.087451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:02.089783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:02.091704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e86de60e-bc71-4966-85d3-764d7c281c26 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.159322 Oct 19 13:15:02.092582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 39/109] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:02.571963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:02.572572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:02.579090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:02.579672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:02.580127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:02.580826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:02.581333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:02.581745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:02.662550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:02.663154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:02.669499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:02.669976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:02.670397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:02.671105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:02.671540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:02.671949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:02.718858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:02.726626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1e015590-de42-4d0c-9b68-5121073b47db tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.158522 Oct 19 13:15:02.727191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 71/110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:02 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:02.804905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:02.814525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1a4903a6-56fa-4e8b-ad07-dda0d9371aa4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.155792 Oct 19 13:15:02.815557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 40/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:02 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:03.123089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:03.123718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:03.130205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.130681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.131109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.131787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.132234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.132649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.278152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:03.282256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:03.288295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:03.289764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:03.291042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d9554068-3c80-4b44-8a09-58ea86132b07 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.172198 Oct 19 13:15:03.291770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 72/112] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:03.754182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:03.755173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:03.765612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.766418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.767121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.768241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.769036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.769713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.837887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:03.838445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:03.845176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.845664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.846090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.846814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:03.847264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:03.847664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:03.921329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:03.923969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:03.931130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4a2cb80e-26db-4cde-8caf-f198597d01e3 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.184163 Oct 19 13:15:03.932208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 41/113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:03 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:03.995229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:04.003091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af34b17e-2c9a-473f-ae7d-c4cfd2cc5f95 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.169413 Oct 19 13:15:04.003673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 73/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:03 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:04.322612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:04.323222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:04.329928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:04.330404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:04.330821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:04.331504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:04.331949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:04.332364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:04.465454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:04.474295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:04.475753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:04.476885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-546c1b75-01da-4c9c-b2de-1f0af73b6313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.158700 Oct 19 13:15:04.477451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 42/115] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:04.957140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:04.957877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:04.965974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:04.966633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:04.967202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:04.968085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:04.968674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:04.969262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:05.027259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:05.028138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:05.035313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:05.035884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:05.036304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:05.037179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:05.037718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:05.038151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:05.104223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:05.112287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3b1b3543-83b7-442f-8a30-89bdecb09caa tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.160599 Oct 19 13:15:05.113004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 74/116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:04 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:05.179910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:05.191894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c87b7a1f-d4c7-4385-8811-bd4c07ec349a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.169015 Oct 19 13:15:05.192545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 43/117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:05 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:05.502587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:05.503217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:05.509438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:05.513098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:05.513098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:05.513098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:05.513098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:05.513419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:05.642556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:05.656158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:05.658419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:05.660065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ff716fd3-3fba-4089-952e-9a5e95c60dbe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.161867 Oct 19 13:15:05.660895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 75/118] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:06.074891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f9160b-f332-4198-a36f-4ad52beca5db", "name": "network-vif-plugged", "status": "completed", "tag": "ceb464db-4cbb-4a17-b5fb-9939a603d6d3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:06.093170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.093710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.094140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.117073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Creating event network-vif-plugged:ceb464db-4cbb-4a17-b5fb-9939a603d6d3 for instance 89f9160b-f332-4198-a36f-4ad52beca5db on hv-cinder-maste Oct 19 13:15:06.117532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118982) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 13:15:06.118213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ba8944cf-1850-4af7-9ed4-f0037d04af41 req-5d69f0d5-6397-42d3-845e-14c59cfaa91c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118982) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 13:15:06.119642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.120080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.120465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.121399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.121853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.122299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.134189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:06.135087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:06.143971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.144477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.146772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.147613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.147788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.148156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.151338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.compute.rpcapi [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 13:15:06.152500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] Releasing lock "compute-rpcapi-router" {{(pid=118982) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 13:15:06.175884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d95238f4-052b-4ea8-a815-667e778aac78 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105511 Oct 19 13:15:06.176450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 44/119] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:15:06.217590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:06.218282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:06.238203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.238706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.239155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.239833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.240279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.240684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.365540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:06.375788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b58b7b9-9c97-4e43-96e0-6b30fce551e6 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.245561 Oct 19 13:15:06.377096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 76/120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:06 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:15:06.403217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:06.411235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4cfa5a41-e67b-49e7-a613-84441dbdb0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.199982 Oct 19 13:15:06.412080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 45/121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:06 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:06.688446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:06.689492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:06.702999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.703590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.703991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.705183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:06.705624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:06.706150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:06.846368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:06.855041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:06.856463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:06.857715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7d5d0d55-e1df-44d1-b8a8-d2629c90640b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.173653 Oct 19 13:15:06.858408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 77/122] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:07.399277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:07.400113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:07.406826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.407394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.408029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:07.408772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.409321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.409844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:07.446235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:07.447541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:07.459446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.460241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.460799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:07.461828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.462429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.462844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:07.562496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:07.572796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ef76fec7-e8ad-4129-b3c2-bcf5a1d12e4f tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.177433 Oct 19 13:15:07.573684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 46/123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:07 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:07.633964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:07.643890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f6c44b9-acad-4e64-8c9c-416ed710e714 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.205626 Oct 19 13:15:07.644471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 78/124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:07 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:07.885729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:07.886335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:07.892755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.893293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.893722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:07.894376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:07.895017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:07.895434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:08.038988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:08.047847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:08.049527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:08.050643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-954c985d-9bed-4ade-b3dc-5cede2bcfc9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.168906 Oct 19 13:15:08.051198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 47/125] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:08.596380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:08.597016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:08.604239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:08.604723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:08.605199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:08.605896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:08.606381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:08.606799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:08.667451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:08.668077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:08.674803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:08.675277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:08.675700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:08.676383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:08.676821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:08.677274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:08.816238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:08.832576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:08.834467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d9a08cf1-bba1-4149-aad4-d26613c3ef0e tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.242445 Oct 19 13:15:08.835094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 79/126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:08 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:08.851165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-75840869-f0ff-4555-b9c2-fc832a5b5cc5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.187464 Oct 19 13:15:08.853283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 48/127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:08 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:15:09.077652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:09.078256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:09.088825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.089355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.089789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:09.090493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.090940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.091357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:09.227994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:09.236905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:09.238178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:09.239261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c3ff83ff-32bd-4c19-b08d-a2d2fd749397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.166986 Oct 19 13:15:09.239838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 80/128] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:09.861840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:09.862626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:09.870977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.871478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.871934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:09.872608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.873080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.873517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:09.879192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:09.880705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:09.889136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.889746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.890286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:09.891239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:09.892104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:09.892883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:10.027418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:10.038663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7574ed26-3282-4b91-a685-f60f63dd0766 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.182910 Oct 19 13:15:10.039732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 49/129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:09 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:10.193238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:10.231930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-085e3aa2-3f14-4a24-9824-a799b56dede9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1322 microversion: 2.1 time: 0.357522 Oct 19 13:15:10.239381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 81/130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:09 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:10.264968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:10.265750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:10.274199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:10.275917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:10.277354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:10.278274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:10.278738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:10.279233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:10.489078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:10.498018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:10.499801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:10.501184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9e5252a-9792-46cb-a114-e31267b072a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.241390 Oct 19 13:15:10.501808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 50/131] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:11.063155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:11.064174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:11.075206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.080361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.080892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.082305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.082781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.083201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.258547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:11.260578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:11.270530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.271385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.272087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.273240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.274004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.274820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.289599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:11.297992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d254d40b-2230-46da-9d73-52661a242a6d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1314 microversion: 2.1 time: 0.239746 Oct 19 13:15:11.301304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 82/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:11 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:11.467463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:11.476254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-775274d4-dbc1-434f-9546-bf642344dcf7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1515 microversion: 2.1 time: 0.224241 Oct 19 13:15:11.476827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 51/133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:11 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:11.500102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:11.502417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:11.508629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.509341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.509769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.510457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.510902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.511309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.532784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:11.534144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:11.548082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.548629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.549250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.550661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.564106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.565071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.621385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lazy-loading 'flavor' on Instance uuid f67d2c13-c71c-4471-b5a4-0b9ea8898613 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:15:11.763689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:11.779293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-736e990e-e69c-4e77-9b1e-e829c5c1972f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613/action" status: 200 len: 32 microversion: 2.1 time: 0.283552 Oct 19 13:15:11.780358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 83/134] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:15:11 2022] POST /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:15:11.789508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:11.791865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:11.792988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:11.794465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:11.799471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-22b1e674-ba0a-4534-be81-0fbdc042d507 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.276004 Oct 19 13:15:11.801498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.802137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.802719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:11.803188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 52/135] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:11.803842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:11.804616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:11.805207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:12.025140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:12.037774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c3b8695-211d-49e2-a0a5-ec933d7d641f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.250912 Oct 19 13:15:12.038646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 84/136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:11 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:15:12.193798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "name": "network-vif-plugged", "status": "completed", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:12.209848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:12.209848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:12.209848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:12.222296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] Creating event network-vif-plugged:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:15:12.228581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-7d4800e2-1b59-4369-a77a-9104e6903c0f req-d76e6948-3366-4470-b8d2-46cdb242527c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038538 Oct 19 13:15:12.229543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 53/137] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:15:12.324700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:12.326456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:12.334846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:12.335712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:12.336325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:12.337861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:12.338572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:12.339327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:12.539900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:12.556648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-336a19e3-8ec8-47fb-9fc7-f30467410944 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1500 microversion: 2.1 time: 0.236299 Oct 19 13:15:12.560043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 85/138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:12 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1500 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:12.832671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:12.833388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:12.835479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:12.843234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:12.843750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:12.844176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:12.845775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:12.846156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:12.847190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:13.038631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:13.051959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:13.054062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:13.055320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fc622145-6bc5-446b-be67-4dbecba7b228 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.227232 Oct 19 13:15:13.056003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 54/139] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:13.065556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:13.066780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:13.074746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:13.075315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:13.075822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:13.076593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:13.077201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:13.077651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:13.244698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:13.255524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-195f254b-9f78-49a4-8d8c-8df6ef5ca527 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.194654 Oct 19 13:15:13.256201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 86/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:13 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:14.081472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:14.082981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:14.092037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:14.093914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:14.094594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:14.096296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:14.097001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:14.097671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:14.279534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:14.280225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:14.290209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:14.290209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:14.291453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:14.297652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:14.298405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:14.299006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:14.326297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:14.450184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:14.459314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f6adde74-aa0d-46c6-b090-ee61cadf05bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.183629 Oct 19 13:15:14.460254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 87/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:14 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:15:14.484618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:14.495147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:14.496962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:14.498281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07c35476-a86c-407a-9121-066998e7487c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.422078 Oct 19 13:15:14.499009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 55/142] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:15.482274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:15.482871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:15.489038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:15.489516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:15.490112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:15.490841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:15.491426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:15.492046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:15.533457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:15.534221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:15.542291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:15.543568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:15.544324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:15.545982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:15.546844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:15.547436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:15.647494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:15.656388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-58d478f1-51d2-4141-bc6c-8eb1ea582159 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.177344 Oct 19 13:15:15.673249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 88/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:15 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:15.706876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:15.722150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:15.723788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:15.725042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c46be759-bf10-40bc-a328-234dd7820ab8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.204606 Oct 19 13:15:15.726372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 56/144] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:16.682071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:16.682674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:16.691867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:16.692830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:16.694095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:16.695160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:16.696313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:16.696983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:16.751637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:16.752240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:16.754234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:16.760092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:16.761128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:16.761693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:16.762540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:16.763119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:16.763667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:16.866248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:16.878843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-464eee3e-ce01-4ecc-9084-8e7fc3941820 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.199370 Oct 19 13:15:16.879501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 89/145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:16 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:16.944076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:16.953328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:16.954825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:16.955926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-20fd50f2-9bdf-4252-a946-4eceeaabc764 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.208741 Oct 19 13:15:16.956477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 57/146] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:15:17.903074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:17.905122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:17.912649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:17.913052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:17.913491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:17.914244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:17.914697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:17.915096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:17.982623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:17.984708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:17.991116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:17.991601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:17.992175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:17.992943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:17.993445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:17.993754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:18.051741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:18.059723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dcddeea9-a0aa-4852-b126-45bc7cbd7f57 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.161182 Oct 19 13:15:18.060300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 90/147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:17 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:18.145422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:18.154478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:18.156278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:18.157395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb7d8ec2-ab31-4596-ba2e-3d58b849eff0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.179072 Oct 19 13:15:18.157961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 58/148] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:19.083877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:19.084458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:19.090911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.091489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.091900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.093026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.093497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.093974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.183060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:19.183839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:19.190319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.190892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.191425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.192231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.192996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.193633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.215326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:19.234908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:19.262804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-04c8b16c-6037-4804-bab4-b5e9fac06c43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.182562 Oct 19 13:15:19.263852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 91/149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:19 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:19.360999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a0a6a1d-ee78-497d-a69a-881ab32ee599"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:19.363276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:19.369412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:19.376653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:19.378124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:19.387894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.388386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.389087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2722341a-93b1-4d03-b894-9a7019eb2d12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1406 microversion: 2.20 time: 0.200088 Oct 19 13:15:19.390799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.391053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 59/150] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:15:19.391929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:19.392387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:19.392807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:19.919782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-731d6b1b-ebd3-426d-90c8-5c2e69c981e5 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "POST /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562629 Oct 19 13:15:19.921112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 92/151] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:15:19 2022] POST /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:15:20.295967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:20.296647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:20.306217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.306701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.307127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:20.307826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.308268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.308682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:20.420716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:20.421769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:20.436960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.442417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.447637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:20.451414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.455158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.455851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:20.583452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:20.593868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5586f8b7-acb4-4c17-b493-d435f4a7c4c2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.310121 Oct 19 13:15:20.594599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 60/152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:20 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:20.856412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:20.866537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:20.868887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:20.870718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fef0cfa5-7716-4db6-909f-743cc82c5ab3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1598 microversion: 2.20 time: 0.455059 Oct 19 13:15:20.871306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 93/153] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:15:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1598 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:15:20.897780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:20.898439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:20.904841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.905607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.906207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:20.906791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:20.907234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:20.907639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:21.034230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-71b3802f-7ec4-4ae3-ae41-b5d2aeeaa9a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140480 Oct 19 13:15:21.035510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 61/154] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Oct 19 13:15:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:15:21.616934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:21.617683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:21.624628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:21.625523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:21.626273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:21.627394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:21.628048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:21.628688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:22.167649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:22.183038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7eeef083-3d47-46ac-8f75-d5cc385a1d54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.569960 Oct 19 13:15:22.197491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 94/155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:21 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:22.753087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:22.770936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:22.771765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:22.772386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:22.790950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] Creating event network-changed:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:15:22.801301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-ca69bc65-fb4e-481d-93eb-fb2d72cf25dc req-4476e365-3737-4f08-b0dd-d2da7d0c8e10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051849 Oct 19 13:15:22.810209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 62/156] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:15:23.207876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:23.209243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:23.218238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:23.220208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:23.220844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:23.221450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:23.222356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:23.222949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:23.223527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:23.538570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:23.549309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-55945ca7-e683-4a14-aa07-557899734ee3 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.346173 Oct 19 13:15:23.550227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 95/157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:23 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:24.578904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:24.579685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:24.594791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:24.595580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:24.596059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:24.600202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:24.600705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:24.601337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:24.790688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:24.800604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-017c3793-1fbd-47f1-9fe4-49b92cb86639 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.229094 Oct 19 13:15:24.801522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 63/158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:24 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:25.830466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:25.831695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:25.848337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:25.849081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:25.849805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:25.851424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:25.856002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:25.857741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:26.061536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:26.071953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ede0b7e0-b74d-473f-9e1d-1cf90926be24 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.248007 Oct 19 13:15:26.073025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 96/159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:25 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:27.096739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:27.097461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:27.104897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:27.105527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:27.106045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:27.106942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:27.107648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:27.108557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:27.270432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:27.279036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-03bc26df-a315-422d-a776-e6e0be783748 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.187061 Oct 19 13:15:27.279844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 64/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:27 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:28.302706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:28.303386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:28.323761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:28.324260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:28.324701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:28.325437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:28.325891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:28.326964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:28.580557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:28.592246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bcd5088b-592c-4bd5-8478-e20858b449c5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.292680 Oct 19 13:15:28.593381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 97/161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:28 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:29.617918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:29.620634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:29.631668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:29.632740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:29.633372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:29.634407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:29.635163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:29.636713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:29.833921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:29.845212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07ada50d-c82d-44f6-80f8-1f0c139b5219 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.232470 Oct 19 13:15:29.853929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 65/162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:29 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:30.868443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:30.869073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:30.878370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:30.879129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:30.879915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:30.881237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:30.882764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:30.883627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:31.177885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:31.192129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b1ef0e3c-07ee-4bd9-af0e-186411ac8e58 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.327230 Oct 19 13:15:31.193453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 98/163] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:30 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:32.219217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:32.219935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:32.229053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.229596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.230740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:32.231450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.231889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.246038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:32.476621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:32.489728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4daab93b-7d7b-4f91-8763-5149b5efb22d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.273746 Oct 19 13:15:32.495347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 66/164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:32 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:32.721930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:32.722497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:32.733309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.733915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.734432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:32.735142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.735589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.745606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:32.779826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:15:32.920392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e2efd574-60e4-4c7e-a0b9-ea8bd2da6526 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "DELETE /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 204 len: 0 microversion: 2.1 time: 0.202904 Oct 19 13:15:32.924795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 99/165] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:15:32 2022] DELETE /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:15:32.931647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:32.932341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:32.939367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.940241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.941431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:32.942352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:32.943036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:32.943654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:33.106763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:33.118773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-25cceade-62f6-4f62-b052-a3efb7ad07cc tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1552 microversion: 2.1 time: 0.191056 Oct 19 13:15:33.129078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 67/166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:32 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:33.519509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:33.520463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:33.529269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:33.532987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:33.537271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:33.537271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:33.537271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:33.537271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:33.710490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:33.719933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4f016d36-41f8-4359-b234-1d4ac26bb4d7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.205709 Oct 19 13:15:33.734668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 100/167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:33 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:34.146105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:34.147479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:34.156040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:34.156699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:34.157226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:34.158147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:34.159062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:34.159631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:34.363259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:34.374439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-028814a5-ec29-4013-95e7-806eb51c5cef tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1552 microversion: 2.1 time: 0.232220 Oct 19 13:15:34.375329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 68/168] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:34 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:34.749496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:34.750618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:34.757395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:34.758153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:34.758781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:34.759820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:34.760443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:34.761158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:34.767690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:34.946795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:34.969716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d0af0bb0-49bf-4202-801e-7bc29cfbcc3c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.225751 Oct 19 13:15:34.970542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 101/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:34 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:35.400824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:35.401846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:35.412826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:35.414505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:35.416568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:35.418506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:35.418984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:35.421075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:35.664923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:35.678175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e070eafd-904e-489f-8a43-7586710bc1a4 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1552 microversion: 2.1 time: 0.282220 Oct 19 13:15:35.694767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 69/170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:35 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1552 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:35.994029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:35.994745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:36.004983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.005752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.006192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.006899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.013455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.014160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.070536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f9160b-f332-4198-a36f-4ad52beca5db", "name": "network-vif-deleted", "tag": "ceb464db-4cbb-4a17-b5fb-9939a603d6d3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:36.089165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.097044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.097729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.115313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] Creating event network-vif-deleted:ceb464db-4cbb-4a17-b5fb-9939a603d6d3 for instance 89f9160b-f332-4198-a36f-4ad52beca5db on hv-cinder-maste Oct 19 13:15:36.132781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-4eac0f4a-0811-4021-8e2f-00924cca2a83 req-da82eaca-0824-4d89-b05f-dc1888f3bee1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065900 Oct 19 13:15:36.133435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 70/171] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:15:36.226944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:36.239154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5d1c6165-2ff5-414c-ad01-d6cb0eac6167 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.249179 Oct 19 13:15:36.240925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 102/172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:35 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:36.710067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:36.710872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:36.717532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.718009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.718580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.719284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.719723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.720140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.753979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:36.754461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:36.754885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:36.755335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lazy-loading 'fault' on Instance uuid 89f9160b-f332-4198-a36f-4ad52beca5db {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:15:36.824000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf61dfe9e94487195fd684a1c96dff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1c4c6f41f4241b86f3b3e6bb2847c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:36.838331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-59626d6b-b42d-48c1-8a11-9b3df6050fd8 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 200 len: 1350 microversion: 2.1 time: 0.133794 Oct 19 13:15:36.840000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 71/173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:36 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:37.267877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:37.269047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:37.276688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:37.277453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:37.278112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:37.278994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:37.279578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:37.280218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:37.475164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:37.489476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-47243f30-c3b7-404b-b798-46f62314d464 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.226692 Oct 19 13:15:37.506151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 103/174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:37 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:37.863390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:37.864749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:37.872334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:37.873154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:37.873841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:37.874787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:37.875430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:37.876356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:37.910330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] HTTP exception thrown: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Request method failure captured: Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db HTTP/1.1 Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_g0To0E5a_47iKkx6MAW-pX2JgCvEnnI_4qS5IjWfoltrq5S2jllYVSh60A2JwA9ukfF7mktKYNIirb0WCqga-5ToSaO1U-iVxIkHey8yGEWugwGcIh0mhCSzdz-cm1urAh1e8l29epqj2KTL8hS2NB_rzcdODVtwXqfW1k3AKg97M Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:15:37.920560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2c1c4c6f41f4241b86f3b3e6bb2847c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: abf61dfe9e94487195fd684a1c96dff6 Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:37.922086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '89f9160b-f332-4198-a36f-4ad52beca5db'} Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:15:37.922962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:37.924825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:37.926368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Returning 404 to user: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:15:37.926368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a68c0a75-3712-433a-918a-ad3c60e80660 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 404 len: 111 microversion: 2.1 time: 0.062467 Oct 19 13:15:37.928957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 72/175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:37 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:15:38.057898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:38.060619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:38.067299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:38.068012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:38.068640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:38.069550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:38.070180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:38.070794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:38.084750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] HTTP exception thrown: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Request method failure captured: Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db/os-volume_attachments HTTP/1.1 Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_g0To0E5a_47iKkx6MAW-pX2JgCvEnnI_4qS5IjWfoltrq5S2jllYVSh60A2JwA9ukfF7mktKYNIirb0WCqga-5ToSaO1U-iVxIkHey8yGEWugwGcIh0mhCSzdz-cm1urAh1e8l29epqj2KTL8hS2NB_rzcdODVtwXqfW1k3AKg97M Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:15:38.089270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2c1c4c6f41f4241b86f3b3e6bb2847c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: abf61dfe9e94487195fd684a1c96dff6 Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:38.090712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'server_id': '89f9160b-f332-4198-a36f-4ad52beca5db'} Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:15:38.091672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:38.093399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:38.095735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Returning 404 to user: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:15:38.097063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-867a790d-ae93-4012-b54b-a8a21db10b36 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043374 Oct 19 13:15:38.098231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 104/176] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:15:38 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:15:38.513090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:38.513717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:38.521405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:38.521580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:38.522171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:38.523008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:38.523620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:38.524156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:38.717142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:38.726211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0e7f6853-79b2-4907-874a-c77761188cf9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.216806 Oct 19 13:15:38.727367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 73/177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:38 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:39.381107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:39.381107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:39.385903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.386392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.386824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:39.387530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.388517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.388517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:39.409785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] HTTP exception thrown: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Request method failure captured: Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db HTTP/1.1 Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_g0To0E5a_47iKkx6MAW-pX2JgCvEnnI_4qS5IjWfoltrq5S2jllYVSh60A2JwA9ukfF7mktKYNIirb0WCqga-5ToSaO1U-iVxIkHey8yGEWugwGcIh0mhCSzdz-cm1urAh1e8l29epqj2KTL8hS2NB_rzcdODVtwXqfW1k3AKg97M Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:15:39.412064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2c1c4c6f41f4241b86f3b3e6bb2847c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: abf61dfe9e94487195fd684a1c96dff6 Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.413852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '89f9160b-f332-4198-a36f-4ad52beca5db'} Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:15:39.414492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.415555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.416719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Returning 404 to user: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:15:39.416719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a69a96cd-494e-4ad3-bf46-39894f894f10 tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "DELETE /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 404 len: 111 microversion: 2.1 time: 0.040451 Oct 19 13:15:39.416719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 105/178] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:15:39 2022] DELETE /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:15:39.423536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:39.424738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] [instance: 89f9160b-f332-4198-a36f-4ad52beca5db] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:39.431202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.431572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.431998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:39.432899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.433361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.433778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:39.450043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] HTTP exception thrown: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Request method failure captured: Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db HTTP/1.1 Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_g0To0E5a_47iKkx6MAW-pX2JgCvEnnI_4qS5IjWfoltrq5S2jllYVSh60A2JwA9ukfF7mktKYNIirb0WCqga-5ToSaO1U-iVxIkHey8yGEWugwGcIh0mhCSzdz-cm1urAh1e8l29epqj2KTL8hS2NB_rzcdODVtwXqfW1k3AKg97M Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:15:39.451482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e2c1c4c6f41f4241b86f3b3e6bb2847c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e2c1c4c6f41f4241b86f3b3e6bb2847c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: e2c1c4c6f41f4241b86f3b3e6bb2847c Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-DeleteServersTestJSON-707516026 Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: abf61dfe9e94487195fd684a1c96dff6 Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-DeleteServersTestJSON-707516026-project Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.453551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '89f9160b-f332-4198-a36f-4ad52beca5db'} Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:15:39.454616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. Oct 19 13:15:39.455963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:15:39.458086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] Returning 404 to user: Instance 89f9160b-f332-4198-a36f-4ad52beca5db could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:15:39.459126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6f59de07-bb73-4d0a-9206-dd2d2706466d tempest-DeleteServersTestJSON-707516026 tempest-DeleteServersTestJSON-707516026-project] 10.222.0.17 "GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db" status: 404 len: 111 microversion: 2.1 time: 0.040167 Oct 19 13:15:39.459699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 74/179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:39 2022] GET /compute/v2.1/servers/89f9160b-f332-4198-a36f-4ad52beca5db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:15:39.753064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:39.753683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:39.761127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.761662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.762551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:39.763426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:39.764679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:39.765818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:40.128252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:40.142370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f060254b-eeef-4f35-a823-3c78a40a15ac tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.396127 Oct 19 13:15:40.145053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 106/180] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:39 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:41.175954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:41.175954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:41.184230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:41.185186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:41.185792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:41.187175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:41.187847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:41.188480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:41.370121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:41.379051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ae56bce-dc61-4c5e-ab05-69fdd4ad8f3a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.208527 Oct 19 13:15:41.405247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 75/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:41 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:42.411012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:42.411917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:42.425843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:42.427484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:42.428064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:42.428773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:42.429308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:42.434552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:42.859463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:42.877632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-30dad331-56dc-4b5c-a63e-bca32a28b06c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.471009 Oct 19 13:15:42.878699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 107/182] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:42 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:43.907854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:43.908509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:43.924086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=46 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:43.925770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:43.926261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:43.926671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:43.927374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:43.927828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:43.928240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:44.352854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:44.364713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7b5dad73-d5b1-4095-ba8d-c62ebf8b5b54 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.466630 Oct 19 13:15:44.380890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 76/183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:43 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:45.396819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:45.397444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:45.404349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:45.407021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:45.407466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:45.408188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:45.413126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:45.414681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:45.987911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:46.003041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28fed71e-555c-41bf-95f3-0bd784aada7a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.609973 Oct 19 13:15:46.004803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 108/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:45 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:47.027427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:47.028612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:47.035862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:47.036638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:47.037316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:47.038644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:47.039318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:47.040944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:47.265162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:47.276283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-898574a5-c764-4358-aba5-027896aa8f2d tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.252902 Oct 19 13:15:47.284840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 77/185] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:47 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:48.300295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:48.305802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:48.349450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:48.351978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:48.352633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:48.353758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:48.354557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:48.355177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:48.731065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:48.754562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7989da1a-9c7a-4f1a-8703-b1b90036cad4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.458411 Oct 19 13:15:48.761369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 109/186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:48 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:49.784121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:49.785587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:49.792766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:49.797528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:49.798156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:49.814411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:49.817991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:49.822002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:49.842767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=96 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:50.707499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:50.725013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5d1a0062-b55f-4b46-93a2-bc2ead590990 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.943018 Oct 19 13:15:50.728678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 78/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:49 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:51.749818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:51.751228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:51.773712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:51.774284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:51.775048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:51.775747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:51.776353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:51.777003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:52.164329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:52.181368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a5bc2b0-3232-431e-b8a4-0e180bf93053 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.434648 Oct 19 13:15:52.184850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 110/188] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:51 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:53.216595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:53.217272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:53.227957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:53.228432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:53.228855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:53.236800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:53.237547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:53.238146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:53.840711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:53.854860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e74a8f97-330c-4cf1-96f0-92af38ecf851 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1521 microversion: 2.1 time: 0.648257 Oct 19 13:15:53.858153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 79/189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:53 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1521 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:54.883611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:54.884245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:54.887234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:15:54.906491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:54.911363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:54.912759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:54.914789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:54.916492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:54.917349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:55.803071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:55.816321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd060473-335d-4ed0-9f56-aba7ec6faa87 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1501 microversion: 2.1 time: 0.939108 Oct 19 13:15:55.821639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 111/190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:54 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1501 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:55.848089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:55.850105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:55.884201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:55.885095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:55.885539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:55.888074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:55.891538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:55.892231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:56.733463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:15:56.764651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab2d1b64-ba46-4f62-abee-45efe45e46c8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1514 microversion: 2.1 time: 0.921415 Oct 19 13:15:56.766034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 80/191] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:55 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1514 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:15:57.743905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0010d920-4b9e-4356-a154-f6bbe1f00c5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'create', calling method: .version_select at 0x7ff4f9374940>, body: {"keypair": {"name": "tempest-keypair-1754313209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBFbui+DN2NmKLQt+lt7PJLsINH2vdDwbVyTKstbLMo6NOrmg7urwd9w1G8JStmnfANfA5jVykSsIUUtnx/Ag1zW6g0dSO8+fKxzWDEbd8UqSqlKxbVscq+QrLRURoEww=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:57.779810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-0010d920-4b9e-4356-a154-f6bbe1f00c5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for project f1e961b210664d81ab76acffd94b70d7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:15:57.790346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-0010d920-4b9e-4356-a154-f6bbe1f00c5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for user ab18c81a3b6a4db98b3007c620950aef and project f1e961b210664d81ab76acffd94b70d7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:15:57.863471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0010d920-4b9e-4356-a154-f6bbe1f00c5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.469990 Oct 19 13:15:57.864526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 112/192] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:15:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:15:58.938409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:15:58.944134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:58.955539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:58.956459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:58.957556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:58.958608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:58.960578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:58.961307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:59.041683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lazy-loading 'flavor' on Instance uuid e6097802-0b69-4ef8-86d2-69b057ba2303 {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:15:59.367767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3187f46a-d264-49a6-af58-4809dfef15b5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/action" status: 200 len: 32 microversion: 2.1 time: 0.433395 Oct 19 13:15:59.368411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 81/193] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:15:58 2022] POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/action => generated 32 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:15:59.378783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:15:59.379404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:15:59.399262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:59.400082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:59.401561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:15:59.402307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:15:59.402769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:15:59.413572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:00.041415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:00.059609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d5fd7171-70e0-41f2-8a9b-8ab7c496d445 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.684952 Oct 19 13:16:00.060208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 113/194] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:15:59 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:01.091932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:01.093117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:01.101334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:01.101334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:01.101334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:01.101970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:01.104023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:01.104631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:01.610099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:01.619181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8ee65597-39fc-4ddd-8f19-d6970654dd4f tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.535046 Oct 19 13:16:01.637262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 82/195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:01 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:01.766595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1616840533", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a057f69b-0e96-4372-ae51-a9f01790a7c2"}], "security_groups": [{"name": "tempest-securitygroup--1274357133"}], "key_name": "tempest-keypair-1754313209", "user_data": "}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:02.036387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] validate_networks() for [('a057f69b-0e96-4372-ae51-a9f01790a7c2', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:16:02.647019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:02.647633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:02.666181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:02.668051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:02.670482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:02.673193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:02.674122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:02.677825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:03.144297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:03.152744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-59986e4c-0413-4dff-ad3b-5696cedc6e47 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.510660 Oct 19 13:16:03.153355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 83/196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:02 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:03.645581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:16:03.646983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:16:03.647742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:16:03.649667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:16:03.650368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:16:03.673112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:03.673770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:03.674385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:03.675216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:03.675843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:03.676530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:03.760805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for project f1e961b210664d81ab76acffd94b70d7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:03.767026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for user ab18c81a3b6a4db98b3007c620950aef and project f1e961b210664d81ab76acffd94b70d7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:03.781489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:16:03.784953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:16:03.953476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e815e471-cb4a-4286-83f7-6a37993971a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.188203 Oct 19 13:16:03.955653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 114/197] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:16:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:16:03.971391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-41b0585b-52dd-408e-b137-3184ef0ae1b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:03.972234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-41b0585b-52dd-408e-b137-3184ef0ae1b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:04.185095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:04.185812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:04.207526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:04.208199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:04.208822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:04.210046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:04.210669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:04.211260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:04.265816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-41b0585b-52dd-408e-b137-3184ef0ae1b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:04.279213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-41b0585b-52dd-408e-b137-3184ef0ae1b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1238 microversion: 2.1 time: 0.316234 Oct 19 13:16:04.279819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 84/198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1238 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:04.570344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:04.579730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-65ebe5de-cb53-4b6a-8906-fb312a671fd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.403120 Oct 19 13:16:04.580644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 115/199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:04 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:05.302578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:05.303188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:05.315445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:05.319004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:05.320785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:05.321833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:05.322289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:05.327554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:05.608060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:05.611324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:05.633076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:05.636808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:05.637503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:05.639372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:05.642001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:05.643678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:05.658161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=71 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:05.724328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:05.744123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e04c4e1-ef78-4620-aa33-0619bceebb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1290 microversion: 2.1 time: 0.438697 Oct 19 13:16:05.749460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 85/200] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1290 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:06.354058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:06.364046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5cb2ea39-faef-4aac-aeea-91e94376758c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.761912 Oct 19 13:16:06.365569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 116/201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:05 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:06.776987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:06.777622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:06.792766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:06.793984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:06.795618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:06.797248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:06.797860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:06.798553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:06.908675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:06.921460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-85ebcc1f-3dc6-4c16-9cce-3b77d365c62c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1296 microversion: 2.1 time: 0.150565 Oct 19 13:16:06.926195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 86/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:07.012089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:07.012811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:07.019800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.020290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.020721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:07.027721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.028460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.029438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:07.090300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-62acfbb7-97e7-4e9e-bedf-1f667d0ca708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/ips" status: 200 len: 151 microversion: 2.20 time: 0.080372 Oct 19 13:16:07.093295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 117/203] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Oct 19 13:16:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/ips => generated 151 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:16:07.388983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:07.389884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:07.400257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.401140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.401575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:07.402287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.403921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.405271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:07.947735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:07.948356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:07.955596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.956082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.956545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:07.964681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:07.965454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:07.966258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:08.042318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:08.063549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f452a89f-cf39-4107-9366-276916529610 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.679016 Oct 19 13:16:08.065115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 87/204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:07 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:08.078343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-725095384", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "networks": [{"uuid": "5bfb9d6c-155a-4c56-b2c5-0bdf354aaee5"}]}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:08.155560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] validate_networks() for [('5bfb9d6c-155a-4c56-b2c5-0bdf354aaee5', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:16:08.464706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:08.480148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c620bddc-62ab-454b-9674-f7733de5ef97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.531765 Oct 19 13:16:08.480769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 118/205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:08.754863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:16:08.755714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:16:08.756359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:16:08.756764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:16:08.757197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:16:08.775131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:08.775922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:08.776362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:08.777112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:08.778279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:08.778881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:08.799793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Getting quotas for project 355a62e6646d4d258d3abc95e7149178. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:08.805354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Getting quotas for user 8cefc194397440018b2c8f1d11d9a445 and project 355a62e6646d4d258d3abc95e7149178. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:08.820530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:16:08.823761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:16:08.902535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1046fa84-9a96-431f-a611-c9e030ab7ad5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835871 Oct 19 13:16:08.903848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 88/206] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:16:08.917210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9cc7a75-458a-4c17-8970-2a9ae6908025 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:08.917868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9cc7a75-458a-4c17-8970-2a9ae6908025 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:09.005724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0101bf0a-6484-4009-a3af-b1fe8359e58a", "tag": "e1685fe2-fdaf-4d04-aef2-ced0d22588f1"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:09.026344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.027015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.027727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.049636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] Creating event network-changed:e1685fe2-fdaf-4d04-aef2-ced0d22588f1 for instance 0101bf0a-6484-4009-a3af-b1fe8359e58a on hv-cinder-maste Oct 19 13:16:09.063000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-32b5eb54-7bd1-486b-a256-7c1c5ad4e810 req-5dcdfd6a-866e-4451-8fcf-a4b9108b180d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061398 Oct 19 13:16:09.066204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 89/207] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:09.095025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:09.098458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9cc7a75-458a-4c17-8970-2a9ae6908025 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:09.098980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:09.111922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9cc7a75-458a-4c17-8970-2a9ae6908025 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1218 microversion: 2.1 time: 0.196778 Oct 19 13:16:09.112961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 119/208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:09.114597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.117594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.118243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.119158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.126887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.127656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.405306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:09.416346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b3b0756e-4fed-4457-a8c0-4a99141146da tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.329772 Oct 19 13:16:09.418213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 90/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:09 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:09.487527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:09.488179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:09.503326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:09.503934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:09.511118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.511917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.512484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.514022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.514637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.515204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.517310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.517812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.518891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.519607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:09.520067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:09.520492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:09.560075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lazy-loading 'flavor' on Instance uuid 26717ab1-6c97-4d22-afe6-d00760711621 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:16:09.764966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:09.774947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c099fe4b-86b8-43e5-8330-9023cfece513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.274836 Oct 19 13:16:09.776077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 91/210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:10.067668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-edd49bd1-6e4c-4e0b-9b4e-db63bc130600 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action" status: 202 len: 0 microversion: 2.20 time: 0.583912 Oct 19 13:16:10.071548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 120/211] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Oct 19 13:16:09 2022] POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:16:10.085237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:10.085980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:10.104092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.104659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.105112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.107080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.124490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.125085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.138635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:10.141422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:10.158209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.158895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.159334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.161380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.161884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.162318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.308893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.336051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.342615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c1296bd-fac6-45c4-aeb2-348a416cab39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1214 microversion: 2.1 time: 0.204124 Oct 19 13:16:10.343976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 121/212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:10.347528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.349525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.350902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-10a822f3-5bcf-4bef-af1c-c610b988ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.278155 Oct 19 13:16:10.361671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 92/213] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:10.443732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:10.444521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:10.453335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.454104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.454985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.455916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.456810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.457597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.628339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.639522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a81a9770-aa80-4062-b1b7-876ce0e71beb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.200330 Oct 19 13:16:10.654017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 122/214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:10 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:10.799321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:10.799924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:10.808316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.809002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.809599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.810568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:10.811350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:10.811778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:10.959293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:10.968632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00dabb43-567a-4e41-97f7-7253fb8cd027 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.173841 Oct 19 13:16:10.969390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 93/215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:11.368776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:11.369781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:11.376277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:11.377816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:11.391017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.393286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.394171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.394499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.395104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.396303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.396986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.399581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.400232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.400671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.402279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.403968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.518234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:11.527581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c9a8c234-3263-4052-abbd-7a76061c37f6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1270 microversion: 2.1 time: 0.163242 Oct 19 13:16:11.528376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 123/216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:11.619451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:11.635422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:11.637726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:11.639342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e2dde150-a1fc-43f5-a70f-c9dd02fa76a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.267510 Oct 19 13:16:11.640282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 94/217] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:11.665413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:11.666801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:11.676151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.676967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.677571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.678292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:11.678743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:11.679160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:11.845209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:11.854575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-03b79df1-7ebb-4871-8754-3eddbb86023e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.193407 Oct 19 13:16:11.855277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 124/218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:11 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:11.991790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:11.992457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:12.006923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.007813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.008396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.009136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.009579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.010174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.013194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:12.196444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:12.212514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-117f26fe-b7a6-484d-acd7-f3c70fb2a02e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.224508 Oct 19 13:16:12.215484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 95/219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:12.551911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:12.552933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:12.582086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.583206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.583863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.584831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.585513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.586134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.670393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:12.671756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:12.684131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.685018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.686004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.687020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.687753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.688283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.917520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:12.931368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:12.933195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:12.934465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af65a7ba-6f19-4bea-af5e-9809cb5bec80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.269462 Oct 19 13:16:12.949505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 96/220] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:12.959671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:12.960454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:12.968199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.969045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.969820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:12.970734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:12.971378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:12.972010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:13.035994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:13.047936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b594b6cf-0f6a-42da-bfd3-4748486aee14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1278 microversion: 2.1 time: 0.500871 Oct 19 13:16:13.048534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 125/221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1278 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:13.144803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:13.153799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4cbe29e9-1c2d-4400-b426-dd9f3c211efc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.202949 Oct 19 13:16:13.156088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 97/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:12 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:13.239907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:13.240542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:13.248653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:13.248653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:13.249111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:13.249808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:13.250297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:13.250661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:13.673561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:13.689143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed7fe75b-5a35-46e9-a322-886510db65d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.452581 Oct 19 13:16:13.698305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 126/223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:13.968488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:13.969143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:13.972843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:13.976486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:13.977208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:13.977790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:13.978769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:13.979151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:13.979711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.075344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:14.076105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:14.081545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:14.083258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.090534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.091234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.092564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.093231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.094064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.149628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.159405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.164330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.165804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5945aef9-ff7c-4b86-b39b-a19ab03953dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.207537 Oct 19 13:16:14.167544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 98/224] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:14.182620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:14.183397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:14.195437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.196073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.196774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.197843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.198430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.199020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.282993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.291441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-daae4b98-6f19-46b6-91df-9ef557dd1e5c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.220042 Oct 19 13:16:14.293775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 127/225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:14 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:14.400856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.412414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5a580d11-c2f6-4dbe-9061-a8493a805919 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.233633 Oct 19 13:16:14.413983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 99/226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:14 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:14.622767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0101bf0a-6484-4009-a3af-b1fe8359e58a", "name": "network-vif-plugged", "status": "completed", "tag": "e1685fe2-fdaf-4d04-aef2-ced0d22588f1"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:14.636023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.636796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.637482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.651279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] Creating event network-vif-plugged:e1685fe2-fdaf-4d04-aef2-ced0d22588f1 for instance 0101bf0a-6484-4009-a3af-b1fe8359e58a on hv-cinder-maste Oct 19 13:16:14.658023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-f804ffa6-3af6-41ab-89da-d31ae5170c4f req-a25c47fe-2f8e-4a1c-969f-2cafd3c3f3e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039037 Oct 19 13:16:14.659204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 128/227] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:14.714423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:14.715032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:14.721997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.722477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.722903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.723593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:14.724030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:14.724469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:14.981013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:14.994237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ba4d9aeb-0c84-445a-af4d-fa2586a46468 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.283171 Oct 19 13:16:14.995033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 100/228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:15.194164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:15.195532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:15.211524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.215530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.217225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.218864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.219355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.219794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.302310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb468a8-83a3-4574-859c-72e04d9ab535", "tag": "c1093210-0052-44af-8f5b-e5f8af5f570b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:15.317579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.318319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.318907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.353688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] Creating event network-changed:c1093210-0052-44af-8f5b-e5f8af5f570b for instance 0bb468a8-83a3-4574-859c-72e04d9ab535 on hv-cinder-maste Oct 19 13:16:15.363027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-56d03835-5770-42b5-808f-b1c3ff28c671 req-cc18ff87-d5ac-4ae8-8ac0-8bf13eab7044 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067271 Oct 19 13:16:15.365380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 101/229] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:15.376405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:15.379098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:15.411231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.413727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.414457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.415903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.417400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.418696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.506160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:15.516655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:15.518674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:15.520208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ba69a8f-a09a-4a83-9836-3199f03ed101 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.331345 Oct 19 13:16:15.521374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 129/230] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:15.526694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:15.527508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:15.534652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.535575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.536167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.537079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.537678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.538256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.621896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:15.633716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-386a4123-3c08-423d-9dae-cba3261db791 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.264559 Oct 19 13:16:15.634721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 102/231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:15 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:15.817076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:15.828196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d6e6917-aa36-439e-b51a-edd25f46b259 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1500 microversion: 2.1 time: 0.305457 Oct 19 13:16:15.829270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 130/232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:15 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1500 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:15.851426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a4902c-11d1-47e3-a943-f1fdbc5b6552"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:15.854193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:15.861287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.861974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.862491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.863249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.863754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.864169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.896705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] HTTP exception thrown: Cannot 'attach_volume' instance e6097802-0b69-4ef8-86d2-69b057ba2303 while it is in vm_state rescued Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Request method failure captured: Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/os-volume_attachments HTTP/1.1 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 74 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_grUiWfjHcKRjENAP_RctiCr9kbAUsDzM_Qr_3wt-wOkw5_G71-z-4onc2teEAMBslvdhpHV4pXJTdRP6ZfWkj3xOqYQIV5LYc-J_Pv1yYr7cjxwKc02k2GAIi9BSd6eLY20KJY6b-PWU3AQrVZKHF1s2-Xrfh9GnfzBWkko6dYeoM Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:16:15.899570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3df7886f27d4ef48cb9031e75a15e46", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: f71530099a11440b9d69f550286d9614 Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {"volumeAttachment": {"volumeId": "24a4902c-11d1-47e3-a943-f1fdbc5b6552"}} Oct 19 13:16:15.901351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Cannot 'attach_volume' instance e6097802-0b69-4ef8-86d2-69b057ba2303 while it is in vm_state rescued Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'server_id': 'e6097802-0b69-4ef8-86d2-69b057ba2303', 'body': {'volumeAttachment': {'volumeId': '24a4902c-11d1-47e3-a943-f1fdbc5b6552'}}} Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:16:15.902234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e6097802-0b69-4ef8-86d2-69b057ba2303 while it is in vm_state rescued Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:16:15.903571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:16:15.905010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:16:15.905010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:16:15.905010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e6097802-0b69-4ef8-86d2-69b057ba2303 while it is in vm_state rescued Oct 19 13:16:15.905010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:16:15.905010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Returning 409 to user: Cannot 'attach_volume' instance e6097802-0b69-4ef8-86d2-69b057ba2303 while it is in vm_state rescued {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:16:15.906030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-102824c2-b694-42d7-ae33-afcc225defb5 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055562 Oct 19 13:16:15.906705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 103/233] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:16:15 2022] POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 13:16:15.915487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:15.916175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:15.925308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.925942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.926565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:15.927366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:15.927944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:15.928457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.007881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:16.018908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:16.019685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:16.033107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.035275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.036100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.038460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.038945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.039224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-405550ee-1a69-4ecf-97b3-bee9d826a0b2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/action" status: 202 len: 0 microversion: 2.1 time: 0.126971 Oct 19 13:16:16.039438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.040761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 131/234] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:16:15 2022] POST /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:16:16.065672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:16.068068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:16.081074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.082411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.083832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.084962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.085684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.086353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.222497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:16.233351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d18a2afe-9bfe-4571-8b52-10e40853c6a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1364 microversion: 2.1 time: 0.218840 Oct 19 13:16:16.238008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 104/235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:16.468154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:16.476316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-91697de2-c065-45cd-bb62-d148a5442565 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1508 microversion: 2.1 time: 0.431205 Oct 19 13:16:16.477049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 132/236] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:16 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1508 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:16.549561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:16.550358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:16.560978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.561672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.562243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.563241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.568348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.569052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.664404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:16.667201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:16.684468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.685714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.686333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.687157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:16.687686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:16.688290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:16.851064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:16.869054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:16.870683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:16.871898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-313c1917-258d-4ff3-80b4-e03632f42e2c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.329340 Oct 19 13:16:16.873028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 105/237] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:17.065086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:17.082818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2e03a619-b030-47a3-84e0-b9143a74a4e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.423200 Oct 19 13:16:17.084040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 133/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:17.259896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:17.260552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:17.271669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.272170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.272598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.275091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.278545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.279327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.480852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:17.492141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6f86064d-219a-4591-bf16-0374ce53385f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1550 microversion: 2.1 time: 0.236286 Oct 19 13:16:17.493703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 106/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:17.500885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:17.501681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:17.509431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.511070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.511867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.512744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.513301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.513736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.517664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:17.518483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:17.525449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.526196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.526793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.527759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.528412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.529075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.618013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c0d3ace6-fd1a-4aaf-b555-5e13715e03c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104665 Oct 19 13:16:17.626966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 107/240] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:16:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:17.796244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:17.804459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-637ef193-cb68-4726-9b39-89e9b5746c56 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1508 microversion: 2.1 time: 0.307756 Oct 19 13:16:17.805076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 134/241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:17 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:17.899843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:17.900825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:17.909575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.910441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.911089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:17.912011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:17.912562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:17.913210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.088569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6467e9ab-dc34-4773-aa87-a0682997183d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'create', calling method: .version_select at 0x7ff4f94f69d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-135362570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI98cSaMBbzrcUFGnlJUd9teTW3mW1GLrSgRUWrJeIKbwzUkKuQ3KpJ6MX8jJWoFCB2URGWV92wN+B4SNloO1lnC6I0D7T1IwiMXgI+aWb8UnqK91lqhaYNUD/daeDtAKQ=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:18.105457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-6467e9ab-dc34-4773-aa87-a0682997183d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Getting quotas for project f16aafb1b5ea4b0b911c62d0acadbc47. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:18.109740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-6467e9ab-dc34-4773-aa87-a0682997183d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Getting quotas for user a3b0b74c4c894c4d84c3a014a33a786d and project f16aafb1b5ea4b0b911c62d0acadbc47. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:18.134115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6467e9ab-dc34-4773-aa87-a0682997183d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049377 Oct 19 13:16:18.134886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 135/242] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:16:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:16:18.145059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:18.145059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:18.148007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.149503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.149503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.150024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.150477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.150896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.314601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:18.326034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3049fa7b-5821-4248-8a75-2713c612c68f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.189835 Oct 19 13:16:18.336901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 136/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:18.336901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2124376792", "imageRef": "fd269f5b-a039-4b1b-ba1a-394b24ebeba2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-135362570", "networks": [{"uuid": "102ca015-1303-469d-aeb2-764e45cada79"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:18.390416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] validate_networks() for [('102ca015-1303-469d-aeb2-764e45cada79', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:16:18.430634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:18.442358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:18.446272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:18.447628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8664f221-5052-47f3-9ae2-ae2b523f2c12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.552762 Oct 19 13:16:18.448919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 108/244] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:18.816110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:16:18.816596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:16:18.817110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:16:18.817654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:16:18.818193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:16:18.827840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:18.828482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:18.831472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.831638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:18.832217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=8 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:18.832403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.833200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.834129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.834975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.835319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.836399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.836897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.837427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.838381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:18.838932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:18.839616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:18.854472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Getting quotas for project f16aafb1b5ea4b0b911c62d0acadbc47. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:18.859039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Getting quotas for user a3b0b74c4c894c4d84c3a014a33a786d and project f16aafb1b5ea4b0b911c62d0acadbc47. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:18.861137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:18.874934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:16:18.877237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd269f5b-a039-4b1b-ba1a-394b24ebeba2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:16:18.931424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0745629e-6236-49d1-b34d-5267d2e05190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600802 Oct 19 13:16:18.932474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 137/245] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:16:18.944659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ebdab5cc-b497-4a6e-8611-fda2b1481aed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:18.945506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ebdab5cc-b497-4a6e-8611-fda2b1481aed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:19.016756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ebdab5cc-b497-4a6e-8611-fda2b1481aed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.026363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ebdab5cc-b497-4a6e-8611-fda2b1481aed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1258 microversion: 2.1 time: 0.086246 Oct 19 13:16:19.028949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 138/246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:19.067550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.076476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4f431083-9a52-4913-a7c1-fa8ca5a9be51 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1508 microversion: 2.1 time: 0.252407 Oct 19 13:16:19.077262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 109/247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:18 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:19.254705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0101bf0a-6484-4009-a3af-b1fe8359e58a", "tag": "e1685fe2-fdaf-4d04-aef2-ced0d22588f1"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:19.264958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:19.265174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:19.265472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:19.277034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] Creating event network-changed:e1685fe2-fdaf-4d04-aef2-ced0d22588f1 for instance 0101bf0a-6484-4009-a3af-b1fe8359e58a on hv-cinder-maste Oct 19 13:16:19.282503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-8f7c8a78-1742-4fb7-8197-f31d2256dbe1 req-5188dc82-dd4f-46d2-88af-6caeded3b68b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031376 Oct 19 13:16:19.283333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 139/248] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:19.352008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:19.352775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:19.359472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:19.359954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:19.360463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:19.361264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:19.361736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:19.362361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:19.475181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:19.476004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:19.482747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:19.483421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:19.483955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:19.485204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:19.485204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:19.485763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:19.495109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.503602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e1e742f0-a1c1-43cd-9c56-353f335bc3b5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.155922 Oct 19 13:16:19.504420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 110/249] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:19 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:19.626979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.635782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.637260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:19.638475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4e249fe-9493-4fa4-9f7b-1c917a487a6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.168288 Oct 19 13:16:19.639041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 140/250] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:20.049592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:20.050206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:20.056489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.057012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.057443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.058145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.058591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.059010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.100200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:20.100944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:20.107111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.107788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.108239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.109191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.109805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.110533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.122160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.130309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6f943ef4-3218-4da2-96d5-815e53e712c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1254 microversion: 2.1 time: 0.084610 Oct 19 13:16:20.130887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 111/251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:20.331098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.339427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7ef0a50c-e343-4b3b-b2b3-6ee12da3dbdd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1508 microversion: 2.1 time: 0.243439 Oct 19 13:16:20.339935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 141/252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:20 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:20.526663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:20.527264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:20.533565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.534039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.534464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.535153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.535610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.536013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.665736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:20.666280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:20.671305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.673494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.673981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.674420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.675124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:20.675577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:20.675994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:20.679859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9dea387a-f84b-40c5-b123-4d7e72cc5fa8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.157446 Oct 19 13:16:20.680672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 112/253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:20 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:20.820128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.835180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.836968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:20.838215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a7615ded-50ba-4b79-b93e-ab0fdf9b6c0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1722 microversion: 2.20 time: 0.177953 Oct 19 13:16:20.838712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 142/254] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:21.154478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:21.155129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:21.163335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.163817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.164210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.165112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.165559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.165976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.170721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:21.230309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:21.241503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fef2314a-e372-4595-b832-ee0fd54486ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1310 microversion: 2.1 time: 0.091373 Oct 19 13:16:21.242305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 113/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:21.363376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:21.363926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:21.370468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.370950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.371406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.372092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.372519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.372998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.703250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:21.703993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:21.710207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.710762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.711282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.712051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.712575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.713242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.766938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:21.775754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01d02d93-879e-447a-9e90-e8e329d221e8 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1514 microversion: 2.1 time: 0.416316 Oct 19 13:16:21.776739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 143/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:21 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:21.872417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:21.873900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:21.881969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.882894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.883669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.884917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:21.885938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:21.886499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:21.888276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:21.897660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8f4c5a61-e046-4551-8dde-a3ce398feabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.198421 Oct 19 13:16:21.901705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 114/257] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:22.264807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:22.266766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:22.274609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:22.275160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:22.275678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:22.277216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:22.277781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:22.278418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:22.402675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:22.418915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-03cb9fe7-12d9-46ba-ba33-713a0791f611 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1316 microversion: 2.1 time: 0.155592 Oct 19 13:16:22.419763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 115/258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:22.436081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:22.456694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:22.461269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:22.473317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b2ea3eb9-a8e3-495e-b26b-ed2239c6dd72 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1743 microversion: 2.20 time: 0.600408 Oct 19 13:16:22.474326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 144/259] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1743 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:22.877228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb468a8-83a3-4574-859c-72e04d9ab535", "name": "network-vif-plugged", "status": "completed", "tag": "c1093210-0052-44af-8f5b-e5f8af5f570b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:22.910090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:22.911314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:22.913435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:22.923223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:22.924275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:22.947534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:22.948025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:22.948449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:22.949330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:22.949865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:22.950773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:22.991591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] Creating event network-vif-plugged:c1093210-0052-44af-8f5b-e5f8af5f570b for instance 0bb468a8-83a3-4574-859c-72e04d9ab535 on hv-cinder-maste Oct 19 13:16:23.013170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-7b5e96ec-84cc-4f38-987e-01bd76c9b61d req-212193b1-3fb4-4b5b-ad7d-cde5a32eba68 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140950 Oct 19 13:16:23.015490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 116/260] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:23.401217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f7eaa80e-ce6c-4614-8104-d114b8904a66 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: .version_select at 0x7ff4f952e790>, body: {"keypair": {"name": "tempest-keypair-952309576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZr7Bg1eCXAvdZo68pdePVqrsr4Bxek7AguH6safjdbU9VMpSgoGCD+nzn10ZIGH0l2WYfcT8cx5z9myIJp345bBgQyDXEDzXuNO+88uXpJqcn+4/tFrQ9AIO97hLUyKQ=="}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:23.453061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-f7eaa80e-ce6c-4614-8104-d114b8904a66 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:23.487224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-f7eaa80e-ce6c-4614-8104-d114b8904a66 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for user f71530099a11440b9d69f550286d9614 and project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:23.580019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f7eaa80e-ce6c-4614-8104-d114b8904a66 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187032 Oct 19 13:16:23.582759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 117/261] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:16:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:16:23.594619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:23.597869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:23.614919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:23.615605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:23.617218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:23.619116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:23.620706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:23.623023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:23.638896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:23.648594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6f74470b-4f78-4991-98dd-5cb788685856 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.729937 Oct 19 13:16:23.653115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 145/262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:22 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:23.700042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:23.704820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:23.761855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:23.763695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:23.764280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:23.765905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:23.769663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:23.770122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:24.145383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:24.160845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:24.163843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:24.165337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-67a2af19-32de-4e3d-bba3-f2258ec68404 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1743 microversion: 2.20 time: 0.511050 Oct 19 13:16:24.180977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 146/263] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1743 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:24.241929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:24.251768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-82e6700b-e3fe-4433-b43a-229b5135e30e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.667648 Oct 19 13:16:24.252625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 118/264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:24.677363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:24.677981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:24.687491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:24.691741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:24.693025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:24.694192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:24.696419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:24.701463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.057431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "name": "network-vif-plugged", "status": "completed", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:25.085227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.086181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.088237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.104169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:25.113673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c7228b8-9f2a-4e9f-ab20-14578414af2c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.441850 Oct 19 13:16:25.125366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] Creating event network-vif-plugged:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:16:25.139417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 147/265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:25.142379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-96206cec-cccf-4052-a879-5071394145fe req-bc5b215f-59f4-49f1-9754-9472edb32d49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094146 Oct 19 13:16:25.145960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 119/266] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:25.193703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:25.194346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:25.204367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.205773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.206225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.208372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.211969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.221207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.277785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:25.279223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:25.287589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.288011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.290421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.291438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.293090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.294684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.567630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:25.578910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-178e3e9c-89c9-4739-a99e-b37db22f210a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.306643 Oct 19 13:16:25.580318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 120/267] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:25.586221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:25.602757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:25.603452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:25.604086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:25.619304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] Creating event network-changed:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:16:25.628927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-1e6105c0-635d-49fc-b145-078d320e36e3 req-a7b57afb-9989-4363-9a21-dd62d6c7adf9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046616 Oct 19 13:16:25.634424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 121/268] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:25.908570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:25.919015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:25.920482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:25.921715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba0b92f0-4254-4cc7-9888-fec7c68ac522 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.732174 Oct 19 13:16:25.939443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 148/269] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:26.146637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:26.147765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:26.155654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.156144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.156574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:26.157385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.157832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.158249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:26.350798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:26.367399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb55173b-e746-4128-bca7-402967561c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.225681 Oct 19 13:16:26.368502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 122/270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:26.603837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:26.604452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:26.615875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.617211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.618678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:26.619427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.620340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.620774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:26.638837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-616508933", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b24227a-7c37-40d0-9993-6b37fb855857"}], "security_groups": [{"name": "tempest-securitygroup--871950786"}], "key_name": "tempest-keypair-952309576", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:26.781456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] validate_networks() for [('0b24227a-7c37-40d0-9993-6b37fb855857', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:16:26.781624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:26.793770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1c993e05-00ef-46ba-8bf1-075387c6c1b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.194588 Oct 19 13:16:26.794362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 149/271] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:26.950456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:26.952581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:26.961084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.961923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.962810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:26.963816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:26.964634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:26.965671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.121093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:27.139035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:27.140584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:27.141838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb93d114-aef4-422a-a43e-eb18d6bee713 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.196608 Oct 19 13:16:27.142389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 150/272] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:27.394914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:27.395530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:27.397358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:16:27.398417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:16:27.404001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.404686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:16:27.405069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.405691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.406046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:16:27.406584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:16:27.407022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.411212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.411664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.422519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.423139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.423694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.424717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.425297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.425818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.456401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:16:27.460879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Getting quotas for user f71530099a11440b9d69f550286d9614 and project c3df7886f27d4ef48cb9031e75a15e46. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:16:27.473898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:16:27.476791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:16:27.544441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e29d9253-421d-480b-8f18-04b3f698ee80 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.910205 Oct 19 13:16:27.545925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 123/273] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:16:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 13:16:27.561945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb948166-27a1-4a20-8c34-77874cb515fc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:27.563009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb948166-27a1-4a20-8c34-77874cb515fc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:27.693705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb948166-27a1-4a20-8c34-77874cb515fc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:27.702054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:27.704697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:27.716832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b942fcd6-db09-40ae-bb02-472832bc1973 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.325760 Oct 19 13:16:27.718173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb948166-27a1-4a20-8c34-77874cb515fc tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1244 microversion: 2.1 time: 0.163956 Oct 19 13:16:27.721673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 124/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:27 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1244 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:27.721808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 151/275] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:27.821266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:27.822339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:27.834117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.834941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.835650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:27.843366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:27.844571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:27.845185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.028520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.047203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2dae1045-afff-440a-a9df-e85745b6aef2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.233119 Oct 19 13:16:28.054561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 152/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:28.171072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:28.172603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:28.185399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.191571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.192626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.193503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.194195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.194383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.394537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.406686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.408140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.409475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b0a3a25c-efe2-4f50-88c4-df2ffa175d84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.243587 Oct 19 13:16:28.410034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 125/277] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:28.755885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:28.757278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:28.763317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:28.764183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:28.765314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.765976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.766728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.767590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.768327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.769158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.776733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.778835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.779410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.780613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:28.782677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:28.788149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:28.844355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:28.881706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.891982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a6552b84-237e-4f6b-b29a-d899001fb7db tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1248 microversion: 2.1 time: 0.132951 Oct 19 13:16:28.902019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 126/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:28 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1248 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:28.955650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:28.964754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6ebab957-8798-4513-bf4b-2e5189d0f990 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.213495 Oct 19 13:16:28.973566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 153/279] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:28 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:29.089518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:29.090159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:29.096779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.097296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.097732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.098434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.101631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.102156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.292392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:29.300570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd28de84-31fb-40a3-bb2e-49c4a7a53092 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.216666 Oct 19 13:16:29.302578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 127/280] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:29.436265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:29.437846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:29.444762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=24 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:29.456942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.456942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.456942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.456942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.457751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.457751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.681891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:29.696117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:29.698251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:29.699437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb88326a-984a-491f-a3b8-ea62bf66d012 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.267659 Oct 19 13:16:29.700300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 154/281] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:29.918728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:29.920759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:29.927747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.928638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.929194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.930284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.931300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.932221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.987863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:29.988659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:29.995387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.996293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.996621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:29.997414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:29.998143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:29.999014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:30.023021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.032365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1e4d211a-1a7c-4587-80c4-8ea24282581a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1248 microversion: 2.1 time: 0.117524 Oct 19 13:16:30.037817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 128/282] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:29 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1248 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:30.180281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.188938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b203c73f-81b5-4cbc-bcd3-66b8fe009c93 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.205120 Oct 19 13:16:30.204507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 155/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:30.326755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:30.327523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:30.335376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:30.336152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:30.336578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:30.337301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:30.338213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:30.338963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:30.517277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.540349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-991e8524-1e95-444c-a8a5-9dcb5fe2b799 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.217530 Oct 19 13:16:30.541378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 129/284] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:30.726439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:30.727180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:30.733728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:30.734241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:30.734674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:30.735376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:30.735829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:30.736250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:30.874876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.883425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.885340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:30.886771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fdb83a44-8976-4f43-ba57-f644d8438697 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.164402 Oct 19 13:16:30.900887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 156/285] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:31.062388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:31.063176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:31.069342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.069929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.070441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.072332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.072332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.072332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.150311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:31.163263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d2bfd701-7eb9-4616-92c7-a606afd010bf tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1248 microversion: 2.1 time: 0.104656 Oct 19 13:16:31.164355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 130/286] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:31 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:31.213292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:31.213897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:31.220676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.221196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.221627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.222344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.222793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.223661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.377370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:31.387593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b6981627-f29d-453d-8f04-676a8b8b5bd0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.178313 Oct 19 13:16:31.388204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 157/287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:31.565977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:31.566617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:31.573349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.573801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.574452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.575150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.575558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.576209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.732086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:31.740460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-908f2653-7507-4d22-a234-4dd28fc45247 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.178373 Oct 19 13:16:31.741081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 131/288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:31.916801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:31.917584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:31.924256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.925094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.925840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:31.926930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:31.927743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:31.928431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.072830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.082929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.084446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.085668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-225a8997-7e7e-49f9-ad21-2a52889acf66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.173069 Oct 19 13:16:32.086240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 158/289] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:32.187152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:32.187758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:32.195096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.195833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.196372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.197236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.197649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.198053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.262456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.271122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d03d1e15-f99d-4f2d-9c5c-937658514f06 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1248 microversion: 2.1 time: 0.087864 Oct 19 13:16:32.271646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 132/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:32 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:32.410659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:32.411272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:32.418071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.418563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.419003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.419710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.420158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.420601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.569230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.578361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-05bd0595-68aa-46e5-8973-3af7d21bfd86 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.171437 Oct 19 13:16:32.578854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 159/291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:32.764721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:32.765548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:32.772083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.772660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.773173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.774266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:32.774786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:32.775233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:32.917630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:32.931398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e77ce88d-124b-4edc-a0cf-651080b2122e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.170216 Oct 19 13:16:32.932205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 133/292] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:33.111292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:33.112109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:33.122458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.123241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.123784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.129981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.130869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.131624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.297103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:33.299476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:33.302939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:33.314990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.317138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.322541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.323309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.323801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.324227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.351118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:33.417939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:33.426994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2450b618-0b00-4a13-bb06-fcda96236afb tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1240 microversion: 2.1 time: 0.135105 Oct 19 13:16:33.433212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 134/293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:33 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:33.549922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:33.559031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:33.560536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:33.561779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ea30c7b8-4aa9-49a9-bcbd-73b18e80900c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.454501 Oct 19 13:16:33.562568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 160/294] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:33.602648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:33.603351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:33.610290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.610840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.611493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.612459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.613006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.613539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.963131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:33.964064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:33.975791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.976608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.979470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:33.980709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:33.982799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:33.983469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:34.086929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.109776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e194238-8905-42d9-8dd6-594858cb2876 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1318 microversion: 2.1 time: 0.500462 Oct 19 13:16:34.109776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 135/295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:33 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:34.324368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.333784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-084bcb34-2819-4733-aaf8-7414fe2522ec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.381208 Oct 19 13:16:34.334418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 161/296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:34.450909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:34.452152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:34.458424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:34.458892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:34.459312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:34.459987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:34.460589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:34.461187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:34.530514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.543574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62970e07-230f-42c9-b6e3-da231e888f98 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1240 microversion: 2.1 time: 0.096629 Oct 19 13:16:34.571949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 136/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:34 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:34.587322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:34.588103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:34.595602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:34.596596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:34.597260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:34.598177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:34.599075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:34.599728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:34.866474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.878968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.883004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:34.886552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d1257a2-d20d-4abf-ae20-88216b860418 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.303421 Oct 19 13:16:34.889309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 162/298] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:35.125399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:35.126308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:35.134823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.135746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.136488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.137675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.138321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.138994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.309146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:35.323503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-34871519-e173-4688-893c-554397356d33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1507 microversion: 2.1 time: 0.203177 Oct 19 13:16:35.333134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 137/299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:35.358989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:35.360260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:35.367126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.367770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.368556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.369116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.369776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.370270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.569989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:35.570599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:35.576535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:35.581965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.582477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.582930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.588552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-88516557-429f-4717-a11c-337fa147f7c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.234608 Oct 19 13:16:35.588734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.588949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.590391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.601344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 163/300] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:35.698336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:35.707328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cac5c4eb-d60b-432e-88cf-1040fa9c4fc0 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1304 microversion: 2.1 time: 0.142554 Oct 19 13:16:35.709336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 138/301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:35 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:35.917206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:35.917825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:35.925353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.926184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.926610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:35.927625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:35.928236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:35.928842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:36.143862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:36.153825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:36.155911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:36.157473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b84642f4-db9b-4670-ab5b-e3f2ecf67b42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.245242 Oct 19 13:16:36.158201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 164/302] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:36.615156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:36.616632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:36.625838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:36.632442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:36.633341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:36.634277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:36.634896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:36.635488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:36.736214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:36.737531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:36.746831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:36.749509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:36.752754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:36.754609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:36.755239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:36.756714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:36.894192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:36.906515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-276d2aba-2f14-4b2a-80cb-83629907af6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.295414 Oct 19 13:16:36.907417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 139/303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:36.995020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:37.003621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-24a5e37a-ba0f-4dd1-8a38-866a6105eca2 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1314 microversion: 2.1 time: 0.271946 Oct 19 13:16:37.004414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 165/304] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:36 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:37.195751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:37.197320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:37.205831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:37.206329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:37.207030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:37.207712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:37.208313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:37.208983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:37.394691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:37.407777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:37.409925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:37.411502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ae1ed984-f183-401c-a7dc-1b6c998efd23 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.220274 Oct 19 13:16:37.412225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 140/305] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:37.934588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:37.935915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:37.953681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:37.954509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:37.957172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:37.958306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:37.959000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:37.965349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:38.028758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:38.029514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:38.031501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:38.032449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=12 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:38.056005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:38.057142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:38.058265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:38.063462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:38.064184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:38.064758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:38.312020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:38.325980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a71d96c-f2ed-456b-b047-e14b25ae636d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.395489 Oct 19 13:16:38.329458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 166/306] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:38.417976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:38.426912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2ab96106-cb5b-4ddf-bcd2-20007de203cd tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.402012 Oct 19 13:16:38.439849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:38.441359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 141/307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:38 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:38.442233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:38.459949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:38.463479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:38.464047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:38.471755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:38.472415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:38.472999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:38.756085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:38.767929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:38.774539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:38.776319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ca6c064f-cc6b-497b-89f2-7516a411b906 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.341564 Oct 19 13:16:38.778961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 167/308] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:39.045075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7b5fee-33a8-490d-bd69-f6459c7bc0de", "tag": "d6575047-ad79-4da2-835f-15fabf3e0f0e"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:39.072533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.074491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.075179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.105128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] Creating event network-changed:d6575047-ad79-4da2-835f-15fabf3e0f0e for instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de on hv-cinder-maste Oct 19 13:16:39.118955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-5a2181eb-318b-4ff1-85ee-9d7e79edea3e req-869c057e-ac7d-4fa2-b399-0067d4ab5d5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086405 Oct 19 13:16:39.120354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 142/309] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:16:39.353207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:39.355308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:39.381946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.382867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.383504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.384453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.385140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.385743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.475053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:39.475053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:39.488335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.489040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.491084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.498446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.500179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.501595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.559995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:39.767137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:39.778272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ea3fb1ed-9aa1-4575-9e01-1287b077a598 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.329589 Oct 19 13:16:39.779523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 143/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:39 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:39.805214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:39.806927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:39.814725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.815619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.816295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.817352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:39.818042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:39.818660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:39.860109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:39.875554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3a3eb778-1a0f-4121-879d-f18cec8c51ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.527173 Oct 19 13:16:39.877110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 168/311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:40.076296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:40.088477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:40.090665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:40.092634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa40f457-790e-4145-b438-49ec3a4f3e9f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.291905 Oct 19 13:16:40.105621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 144/312] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:40.804846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:40.806284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:40.815044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:40.815875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:40.816630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:40.817686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:40.818296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:40.818896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:40.904009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:40.904616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:40.925591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:40.927589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:40.929373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:40.930880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:40.932756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:40.934628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:41.115229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:41.127649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-888ea494-2909-4d9f-a0cd-2f066b7fe1af tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.326648 Oct 19 13:16:41.130789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 169/313] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:40 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:41.138119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "name": "network-vif-plugged", "status": "completed", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:41.161458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:41.169586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:41.170351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:41.182283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:41.192372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9a82f93f-2c67-4127-ab9d-b177c1210d47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.292701 Oct 19 13:16:41.193897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 145/314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:41.196290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] Creating event network-vif-plugged:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:16:41.199070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:41.200079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:41.206597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-ff1427e3-6eb4-436f-a54a-83e04d113ba7 req-8988cdaf-31a0-4a3d-af79-d43b8315c055 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072192 Oct 19 13:16:41.209540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:41.210529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:41.211256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:41.211500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 170/315] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:41.212567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:41.213745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:41.214549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:41.455542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:41.470558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:41.473108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:41.474341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5a0a04d6-5143-4956-9343-18eff5f41a4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.279198 Oct 19 13:16:41.487909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 146/316] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:42.155983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:42.157958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:42.167905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.168417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.168848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.169571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.170219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.170797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.217305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:42.219006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:42.225682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.226310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.227004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.227914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.228659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.229327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.331683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:42.340542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb04e8fe-6202-4d45-9275-e379f0cb694c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.189470 Oct 19 13:16:42.341151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 171/317] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:42 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:42.422360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:42.430822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d826ad21-8c30-4b34-8e11-64255f63bbeb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1358 microversion: 2.1 time: 0.217242 Oct 19 13:16:42.431372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 147/318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:16:42.516786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:42.517540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:42.525473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.526276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.526933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.527972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:42.529201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:42.529865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:42.698023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:42.712336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:42.714218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:42.715523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0030f042-eadc-45cc-bab3-95ff2cf1cb3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.203023 Oct 19 13:16:42.738260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 172/319] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:43.368328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:43.369691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:43.376390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.376979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.377649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.378519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.379026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.379499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.459349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:43.461851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:43.472931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.473699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.474289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.475154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.476466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.476912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.629847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.638185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-31b31343-1b18-4f71-9be6-df9ff54f0408 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.274078 Oct 19 13:16:43.639344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 148/320] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:43 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:43.692386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.704822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b9ad90a6-87d2-48d4-8810-17e57cbb86c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1548 microversion: 2.1 time: 0.253814 Oct 19 13:16:43.705756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 173/321] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1548 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:43.728321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:43.729359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:43.740854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.741484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.741612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:43.741996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.742190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:43.742824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.744212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.744302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.748613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.749318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.749838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.750542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:43.750991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:43.751416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:43.951380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.972514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.976525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.978030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:43.979481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9f61b20-5cc2-4fdd-8069-b244a3ecc054 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.241903 Oct 19 13:16:43.981850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-13e2873d-16f8-48f7-b67e-eeb8a42e0b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1548 microversion: 2.1 time: 0.257208 Oct 19 13:16:43.982400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 149/322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:43.989829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 174/323] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:44.016006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:44.021424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:44.022419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Searching by: {'deleted': False, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47'} {{(pid=118982) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 13:16:44.029982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.030821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.031608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.032702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.033344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.033943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.136815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.multi_cell_list [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118982) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 13:16:44.242766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d18bdc38-d0ad-4f06-b255-e7935dfa07fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230994 Oct 19 13:16:44.244189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 150/324] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Oct 19 13:16:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:44.256236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:44.257187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:44.265877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.266518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.266955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.267665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.268114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.268529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.461598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:44.475532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b81f12a7-496d-4c88-8403-36f46bda111c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1548 microversion: 2.1 time: 0.223309 Oct 19 13:16:44.476183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 175/325] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:44.662385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:44.663314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:44.672953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.673613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.674178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.675002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:44.675495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:44.676008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:44.708079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:44.995322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:45.006953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1da0cd31-0c9e-4d52-a9a7-460ea4bc3858 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.348364 Oct 19 13:16:45.007958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 151/326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:44 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:45.038540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:45.039173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:45.051710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:45.052704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:45.053404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:45.054813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:45.056218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:45.056915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:45.248364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:45.257468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:45.259048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:45.260287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-adc3ebb1-1415-41b3-bf17-c60888da2a98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.240665 Oct 19 13:16:45.260923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 176/327] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:46.035737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:46.036474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:46.042751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.043232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.043663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.044369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.044808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.045354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.215043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:46.225944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3729f170-cb16-40e2-99c8-1370f9037f02 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.193960 Oct 19 13:16:46.227450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 152/328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:46 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:46.296424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:46.297278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:46.304554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.305194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.305851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.306791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.307315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.307799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.399056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4ad7386-201d-41f1-a108-11867637f00d"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:46.401453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:46.409317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.409994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.410580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.412349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:46.419138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:46.419760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:46.497455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:46.510733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:46.512521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:46.514037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4cde7283-b28f-4384-9004-5f9e690d73d7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1738 microversion: 2.20 time: 0.229124 Oct 19 13:16:46.514629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 177/329] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:47.253344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:47.254161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:47.260957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:47.261446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:47.261884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:47.262586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:47.263079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:47.263489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:47.401685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:47.413303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eaee9876-d488-4e5f-ba88-280cf57dd32b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.165447 Oct 19 13:16:47.414184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 178/330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:47 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:47.541865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:47.542470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:47.548601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:47.549131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:47.549569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:47.550865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:47.551323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:47.551750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:47.872469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d14acb22-f7fb-4f85-beea-3cc31a6af7f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477599 Oct 19 13:16:47.873216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 153/331] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:16:46 2022] POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 194 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:16:47.991958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:48.000273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:48.001745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:48.002976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7e4d8f09-00a5-4199-a6f4-bdb7e006343b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1720 microversion: 2.20 time: 0.465316 Oct 19 13:16:48.003871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 179/332] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1720 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:48.442801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:48.443624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:48.450366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:48.450928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:48.451356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:48.452050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:48.452495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:48.452944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:48.599444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:48.607677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-433baccc-29c5-46dd-b2de-227795aa31a4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.171069 Oct 19 13:16:48.608393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 154/333] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:48 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:49.030222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:49.030803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:49.033399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:49.039573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:49.040137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:49.040585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:49.041337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:49.041789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:49.042210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:49.200277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:49.209183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:49.212918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:49.212918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3030db22-77cb-4c4d-bf3f-2b8edec6bf9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1720 microversion: 2.20 time: 0.185687 Oct 19 13:16:49.221316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 180/334] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:49.631069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:49.631832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:49.638567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:49.639055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:49.639498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:49.640187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:49.640627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:49.641064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:49.775072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:49.783056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e746dda-5a70-4489-9f3e-5b3762e252ea tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.155987 Oct 19 13:16:49.783634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 155/335] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:49 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:50.238834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:50.239673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:50.247242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:50.247809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:50.248315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:50.249427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:50.250037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:50.250590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:50.388943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:50.399239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:50.400668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:50.401855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-afaf4b18-5843-4faa-94a0-53d72d595877 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1720 microversion: 2.20 time: 0.167866 Oct 19 13:16:50.402409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 181/336] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:50.811646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:50.812380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:50.819576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:50.820058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:50.820537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:50.821346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:50.821787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:50.822193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:50.850462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "name": "network-vif-unplugged", "status": "completed", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:50.862777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:50.863456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:50.863948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:50.892587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] Creating event network-vif-unplugged:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:16:50.902719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-9a29051f-72d9-46f0-a3c8-8e2db64caff6 req-5077e0ee-8e74-462e-a3b7-b183065c7367 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057633 Oct 19 13:16:50.903981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 182/337] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:50.972053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:50.980953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c0ac0185-7cb8-4fd1-98df-82e6671c8bd4 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.178249 Oct 19 13:16:50.982000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 156/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:50 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:51.431202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:51.432097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:51.439207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:51.439702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:51.440198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:51.441108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:51.441560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:51.441979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:51.594921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:51.603408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:51.604829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:51.606018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3819966a-a6fe-4a2a-9008-4739f4b714a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1723 microversion: 2.20 time: 0.181583 Oct 19 13:16:51.606577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 183/339] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:51.631057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c605cae0-5390-4e87-a5d3-70e96905cfda"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:51.633521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:51.639952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:51.640451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:51.640879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:51.641590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:51.642055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:51.642462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:51.968826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e94d7c8-0fb6-4b72-b1e2-f2b50f3a0be3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341925 Oct 19 13:16:51.969952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 157/340] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Oct 19 13:16:51 2022] POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:16:52.005265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:52.005879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:52.012208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.012691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.013146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.014000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.014454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.015437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.105796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:52.106385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:52.112749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.113289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.113698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.114487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.115129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.115582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.159158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:52.160072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118982) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 13:16:52.167503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-61835fcb-1cf7-414b-ae04-577f80f8b530 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.166196 Oct 19 13:16:52.180966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 184/341] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:52 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:52.236560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5309df30-95bd-43bd-936f-5febbb220adc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action" status: 202 len: 0 microversion: 2.20 time: 0.134677 Oct 19 13:16:52.237242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 158/342] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Oct 19 13:16:52 2022] POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:16:52.245868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:52.246598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:52.256490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.257019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.257430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.258174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.258639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.259050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.401329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:52.411151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:52.411964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:52.413175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b166181-4f12-41f3-98b1-5465a2c6f396 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1749 microversion: 2.20 time: 0.171271 Oct 19 13:16:52.413743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 185/343] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:16:52.949460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7b5fee-33a8-490d-bd69-f6459c7bc0de", "name": "network-vif-plugged", "status": "completed", "tag": "d6575047-ad79-4da2-835f-15fabf3e0f0e"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:52.961353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:52.962321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:52.962905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:52.975328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] Creating event network-vif-plugged:d6575047-ad79-4da2-835f-15fabf3e0f0e for instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de on hv-cinder-maste Oct 19 13:16:52.980261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-5ee617a4-c6ee-4378-9665-0cc899933e14 req-ffc68973-052d-446b-900e-e905b7d97433 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035068 Oct 19 13:16:52.981174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 159/344] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:53.192813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:53.193518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:53.201309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.201818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.202259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.202951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.203460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.203891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.221267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:53.344673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:53.353261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59e89b01-5a67-460b-b789-3304290c01c6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.165314 Oct 19 13:16:53.354152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 186/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:53 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:53.440054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:53.440759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:53.448315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.448794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.449258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.449969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.450400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.450815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.483460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e18cc3ff-ad89-4bae-80a9-4fda2206a1b2", "device": "/dev/sdb"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:53.486315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:53.493150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.494096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.494749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.495462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:53.495886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:53.496519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:53.589965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:53.600995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:53.602712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:53.604045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b91d8c3d-573e-4589-8f57-382abca4d820 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1749 microversion: 2.20 time: 0.168964 Oct 19 13:16:53.604756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 160/346] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:53.782001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-268ed980-7ff7-48a5-bba0-43518366bfa0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "POST /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302422 Oct 19 13:16:53.782605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 187/347] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:16:53 2022] POST /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:54.378759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:54.379362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:54.381841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:54.388132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:54.388579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:54.389042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:54.389730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:54.390175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:54.390589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:54.528211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:54.536096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b0fc80ee-8ed2-4532-8a1b-eaeba88ced2e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1369 microversion: 2.1 time: 0.161273 Oct 19 13:16:54.536677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 161/348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:54 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:54.633904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:54.634604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:54.641460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:54.641949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:54.642391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:54.643081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:54.643541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:54.643964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:54.796081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:54.809692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:54.811137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:54.812355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7e5ebd83-ca52-45b7-a93e-1340137fac44 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1751 microversion: 2.20 time: 0.183494 Oct 19 13:16:54.812983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 188/349] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:55.563767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:55.564425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:55.574730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.575314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.575969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.576828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.577494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.578085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.712016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:55.719877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-94861fbb-8ab2-45f5-b51f-304be8d3a62a tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1563 microversion: 2.1 time: 0.162454 Oct 19 13:16:55.720439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 162/350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:55 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:55.742808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:55.743338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:55.750423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.750895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.751690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.752003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.752460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.752913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.833903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a26f0025-8f4c-4b9d-b932-623981ac7842 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095144 Oct 19 13:16:55.834471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 189/351] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:16:55 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:55.838890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:55.839494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:55.846126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.846602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.847141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.847697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:55.848141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:55.848551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:55.994387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:55.997140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:16:56.011001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:56.012641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:56.013943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dc562539-c470-4760-a865-8ba7ecbcf154 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1751 microversion: 2.20 time: 0.179487 Oct 19 13:16:56.014722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 163/352] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:56.854411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7b5fee-33a8-490d-bd69-f6459c7bc0de", "tag": "d6575047-ad79-4da2-835f-15fabf3e0f0e"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:16:56.864218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:56.864688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:56.865150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:56.876812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] Creating event network-changed:d6575047-ad79-4da2-835f-15fabf3e0f0e for instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de on hv-cinder-maste Oct 19 13:16:56.881994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-ce56ae58-c25f-403e-a40b-cca1c01e7ae5 req-c9e8f219-5dde-4a0d-8c53-ce37f30b99b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031712 Oct 19 13:16:56.882899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 190/353] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:16:57.041187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:57.042657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:57.059713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:57.060168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:57.060793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:57.062117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:57.062706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:57.063258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:57.237285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:57.246793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:57.248611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:57.249888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dea3bc55-1354-4996-b231-7c08156910a1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1751 microversion: 2.20 time: 0.213696 Oct 19 13:16:57.250453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 164/354] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:57.700617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:57.701432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:57.708210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:57.708679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:57.709306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:57.710259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:57.710713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:57.711132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:57.876616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:57.886919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52daa9e4-d414-4a33-9b7f-490fe08fdc91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1594 microversion: 2.1 time: 0.192185 Oct 19 13:16:57.887532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 191/355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:16:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1594 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:16:58.278749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:58.279587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:58.294221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:58.294826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:58.295438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:58.296150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:58.296596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:58.297059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:58.435524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:58.445704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:58.447163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:58.448332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-75a50446-d807-49a6-a33a-c4876bd4a6ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.175050 Oct 19 13:16:58.449011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 165/356] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:16:59.478101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:16:59.478765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:16:59.486577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:59.487070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:59.487673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:59.488409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:16:59.488876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:16:59.489360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:16:59.716190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:59.725410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:59.727338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:16:59.728883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fe1719f2-275e-4891-baef-a610b2fd9e9a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.254906 Oct 19 13:16:59.729667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 192/357] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:16:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:00.597140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:00.609603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:00.610485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:00.611210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:00.624920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] Creating event network-changed:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:17:00.631576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-739ad92a-45c9-4f07-81d6-19237beaab0d req-023c067b-c73f-4aca-8223-7e980a4ae471 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Oct 19 13:17:00.637044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 166/358] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:17:00.764180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:00.765517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:00.775467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:00.776257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:00.776854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:00.777961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:00.778547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:00.779162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:01.052418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:01.065266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:01.067498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:01.068988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fee0a897-f9c3-4ba7-873d-edea87ec20d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.308800 Oct 19 13:17:01.086223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 193/359] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:02.060298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1282116389"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:02.061170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:02.073570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.074102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.074603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.075551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.076191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.076802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.095909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:02.096614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:02.103770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.104618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.105281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.106204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.106854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.107473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.244444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.network.security_group_api [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Adding security group 6bd5f6ff-c97a-47d9-800b-47b7a2c28c88 to port c4155421-8ec4-4ae0-beed-d2f66efefb43 Oct 19 13:17:02.286057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:02.308471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:02.313111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:02.314629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bec74f33-c78b-4a9a-af09-6c6b5f11e1a4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.222829 Oct 19 13:17:02.315691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 194/360] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:17:02.662999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fac1a7bc-af60-4a17-bf20-02d22a6847c0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.607844 Oct 19 13:17:02.664326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 167/361] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:17:02 2022] POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:17:02.671233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:02.677653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:02.678278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:02.685233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.685984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.686620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.687867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.688298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.688766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.694380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:02.695330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:02.695970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:02.718860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] Creating event network-changed:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:17:02.728196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-89218173-1d7e-4d19-8229-c9bfdb7cee50 req-25ef07b5-cc55-4ef5-b45b-7b2e03c4ef59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060631 Oct 19 13:17:02.729434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 195/362] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:17:02.882867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:02.893802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2e967aec-73ad-4cb0-8bd8-20e5505bd50c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1641 microversion: 2.1 time: 0.219733 Oct 19 13:17:02.894688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 168/363] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1641 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:03.344961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:03.346305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:03.352890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:03.353623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:03.354485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:03.355556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:03.356722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:03.357323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:03.508525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:03.517274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:03.518718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:03.519889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-18c2ef28-394a-48bc-a843-b7efaccd7dbc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.180217 Oct 19 13:17:03.520448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 196/364] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:04.549070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:04.550060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:04.554091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:04.561230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:04.561677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:04.562108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:04.562919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:04.563374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:04.563781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:04.736129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:04.746526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:04.748221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:04.749505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-85c99e60-9443-4e65-8794-f3ce4c9fbce6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.206983 Oct 19 13:17:04.750270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 169/365] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:05.775192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:05.775828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:05.782598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:05.783093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:05.783529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:05.784265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:05.784835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:05.785237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:05.931781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:05.940648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:05.942116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:05.943333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4dc21f1f-5f70-4dc0-9c3a-50c7d06ad286 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.172658 Oct 19 13:17:05.943926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 197/366] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:06.969959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:06.970566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:06.977476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:06.977965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:06.978402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:06.979093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:06.979539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:06.979957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:07.121781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:07.131092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:07.132530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:07.134867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-444d5ac1-3064-494d-9657-275f4fc9d586 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.168937 Oct 19 13:17:07.135798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 170/367] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:08.171415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:08.172027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:08.178062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:08.178553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:08.178982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:08.179676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:08.180305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:08.180733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:08.354232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:08.368434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:08.370366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:08.372308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0a82c67c-a9e9-41c9-9978-a23153430313 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.205351 Oct 19 13:17:08.373308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 198/368] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:09.398728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:09.399381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:09.406707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:09.407178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:09.407598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:09.408274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:09.408723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:09.409170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:09.560212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:09.569815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:09.571626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:09.572794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c8a04b3-c187-4f92-8ca1-67003aa34b85 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.178432 Oct 19 13:17:09.573409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 171/369] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:10.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:10.602676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:10.622465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:10.622959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:10.623391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:10.624203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:10.624651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:10.625101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:10.770327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:10.779525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:10.781116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:10.782379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1bbfdb6b-cefe-422a-9743-932c8548dd21 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.186150 Oct 19 13:17:10.782940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 199/370] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:11.811449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:11.812271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:11.819685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:11.820161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:11.820583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:11.821322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:11.821754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:11.822166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:11.959052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:11.967817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:11.969706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:11.970892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2ae2edfb-4e57-4e95-a61e-8f881f81b052 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.164979 Oct 19 13:17:11.971430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 172/371] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:12.998586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:12.999390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:13.008366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:13.009042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:13.009615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:13.010522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:13.011118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:13.011679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:13.152523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:13.161732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:13.163152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:13.164309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ed71113-152d-4e4b-9515-a55922e516f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.171152 Oct 19 13:17:13.164882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 200/372] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:14.190396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:14.191154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:14.197923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:14.198401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:14.198825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:14.199520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:14.199960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:14.200375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:14.332550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:14.341073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:14.342499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:14.343641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-93c2d7fe-b878-4f52-9495-8bc97328cda0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.157682 Oct 19 13:17:14.344190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 173/373] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:15.342170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:15.342709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:15.349772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:15.350265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:15.350702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:15.351414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:15.351872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:15.352292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:15.369725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:15.370402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:15.377642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:15.377930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-afe18162-9b73-4762-a3b2-e228bafc01ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/ips" status: 200 len: 146 microversion: 2.1 time: 0.040039 Oct 19 13:17:15.378350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:15.378527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 201/374] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:17:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:17:15.378949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:15.379788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:15.380318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:15.380822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:15.525541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:15.537607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:15.539028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:15.540175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f1957877-34b8-4fab-9734-60fbcd8502f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.174742 Oct 19 13:17:15.540709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 174/375] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:16.565826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:16.567466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:16.575977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:16.576572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:16.577087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:16.577872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:16.578529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:16.579179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:16.730310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:16.739309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:16.740661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:16.741861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c504f5c3-d87d-462d-8dc5-073cd09fc579 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.180319 Oct 19 13:17:16.742419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 202/376] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:17.708359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd2712ba-99ea-45f7-b7f3-d747ee33c9ac"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:17.711106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:17.718083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:17.718600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:17.719114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:17.719899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:17.720340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:17.720749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:17.768077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:17.768077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:17.775731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:17.776223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:17.776649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:17.777365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:17.777811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:17.778229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:17.921146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:17.923491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:17.931944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:17.933414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:17.934589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9b6f8daa-c733-4882-9c33-123acdf0b0cd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.171145 Oct 19 13:17:17.935141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 203/377] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:18.960895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:18.961676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:18.968734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:18.969232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:18.969664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:18.970355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:18.970799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:18.971233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:19.109380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:19.118303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:19.119816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:19.121016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec33dab9-e9cd-491d-b0bc-394d3fe8ca75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.164573 Oct 19 13:17:19.121607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 204/378] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:19.379478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-deacfaef-b584-4ea6-8cb0-d051ce09730a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.675263 Oct 19 13:17:19.380440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 175/379] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:17:17 2022] POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 194 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:17:20.146382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:20.147136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:20.150016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=50 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:20.155580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:20.156068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:20.156536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:20.157239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:20.157693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:20.158126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:20.342780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:20.352012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:20.353890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:20.355071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-955690fc-1a06-43cb-ba6f-a516d58ed0c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.212881 Oct 19 13:17:20.355634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 205/380] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:21.381533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:21.382224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:21.389618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:21.390085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:21.390508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:21.391182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:21.391624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:21.392034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:21.536178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:21.545444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:21.546866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:21.548017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f3f61fc6-9ffe-4844-a9f8-f9b7536e866c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.170989 Oct 19 13:17:21.548573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 176/381] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:22.580584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:22.581319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:22.589134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:22.589629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:22.590069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:22.590779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:22.591237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:22.591662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:22.724420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:22.734248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:22.735714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:22.736896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-57f96398-556a-4e33-9911-447c2821a75b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.160817 Oct 19 13:17:22.737423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 206/382] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:23.762860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:23.763457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:23.770493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:23.770971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:23.771720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:23.772076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:23.772895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:23.773320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:23.909952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:23.919738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:23.921163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:23.922306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-81f3aaa6-02a5-4038-a738-6b82f5bc0fde tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.163630 Oct 19 13:17:23.922899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 177/383] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:24.948190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:24.948800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:24.955776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:24.956273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:24.956773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:24.957478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:24.957937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:24.958369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:25.090831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:25.099755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:25.101237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:25.102376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4bba326a-2e6a-45be-ab71-c39ef9c336f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.158315 Oct 19 13:17:25.102980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 207/384] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:26.127789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:26.128369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:26.135273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:26.135755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:26.136218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:26.136899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:26.137383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:26.137787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:26.278887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:26.288208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:26.289676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:26.290836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee45cb8c-a2df-4208-8a49-9cda48a581e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.167027 Oct 19 13:17:26.291427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 178/385] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:27.315884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:27.316487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:27.323522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:27.324009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:27.324441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:27.325192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:27.325638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:27.326149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:27.470673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:27.479735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:27.481230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:27.483024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-291cf175-ba2e-4979-b591-e06d6a1b6ad7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.171208 Oct 19 13:17:27.483559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 208/386] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:28.508634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:28.509278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:28.516514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:28.517092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:28.517515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:28.518193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:28.518635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:28.519045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:28.521824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:28.666525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:28.677181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:28.678606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:28.679767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4f9622e-dc6c-4f79-93b3-d75158baa5a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.175165 Oct 19 13:17:28.680270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 179/387] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:29.055814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "name": "network-vif-plugged", "status": "completed", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:29.066726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:29.067206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:29.067635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:29.078973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] Creating event network-vif-plugged:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:17:29.084274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-da1d98c1-c784-4a76-a09f-d35fb9361110 req-d4491f29-0a3d-4719-8336-bf021e91bc07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Oct 19 13:17:29.084870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 209/388] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:17:29.709650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:29.710443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:29.719301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:29.719773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:29.720193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:29.720890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:29.721350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:29.721765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:29.866399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:29.875886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:29.877409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:29.878627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-09595373-d0cb-428a-b970-27d28988ef86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.174663 Oct 19 13:17:29.879213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 180/389] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:30.906432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:30.907137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:30.913990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:30.914469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:30.914903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:30.915583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:30.916032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:30.916452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:31.074919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:31.084398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:31.085903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:31.087077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0251a29e-3203-4085-8d82-ef735d4c28af tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.186256 Oct 19 13:17:31.087624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 210/390] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:32.113442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:32.114005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:32.120964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:32.121452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:32.121883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:32.122577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:32.123025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:32.123441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:32.261570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:32.270739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:32.272508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:32.273664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6031924e-a235-4829-a47e-825cafc3f603 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.164320 Oct 19 13:17:32.274214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 181/391] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:33.299506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:33.300096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:33.306917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:33.307403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:33.307835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:33.308518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:33.309008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:33.309437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:33.444630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:33.453633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:33.455069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:33.456225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75c13077-1212-47ef-9a4c-52a9b09238ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.160615 Oct 19 13:17:33.456778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 211/392] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:34.481872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:34.482458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:34.489558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:34.490123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:34.490469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:34.491142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:34.491623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:34.492022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:34.639644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:34.648957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:34.650385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:34.651540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-602fe4ca-df6b-4505-80a2-e5ab0272781b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.173602 Oct 19 13:17:34.652081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 182/393] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:35.681540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:35.682374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:35.690827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:35.691319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:35.691747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:35.692421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:35.692887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:35.693312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:35.827803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:35.841782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:35.843787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:35.844981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5fca236d-4d01-411c-b9cc-bcebccd43277 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.170217 Oct 19 13:17:35.845551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 212/394] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:36.874769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:36.875681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:36.879354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:36.888676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:36.889533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:36.889957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:36.890626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:36.891062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:36.891493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:37.031200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:37.040644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:37.042075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:37.043650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5c04d1f5-c8e9-4956-950c-3a04d00678e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.175140 Oct 19 13:17:37.044250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 183/395] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:38.073521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:38.074483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:38.085554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:38.086348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:38.087059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:38.088191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:38.088938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:38.089665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:38.230297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:38.240067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:38.241578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:38.242751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d1cbeb2-b591-4af6-a9a6-b7618c7c3421 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.175995 Oct 19 13:17:38.243315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 213/396] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:39.272453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:39.273472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:39.283561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:39.284032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:39.284451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:39.285169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:39.285605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:39.286005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:39.425365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:39.438466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:39.439889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:39.441069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8b150e5-32d4-43a9-a8f6-7d36f40d85f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.175671 Oct 19 13:17:39.441614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 184/397] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:40.471016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:40.471993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:40.482864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:40.483645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:40.484370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:40.485478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:40.485931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:40.486349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:40.637874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:40.647939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:40.649381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:40.651006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8601c4a7-d51b-47c0-b818-8707dbda5205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.186546 Oct 19 13:17:40.651564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 214/398] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:41.676511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:41.677075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:41.683837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:41.684310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:41.684729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:41.685437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:41.685875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:41.686289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:41.821781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:41.830923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:41.832499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:41.833681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07997b90-95cc-469b-ab52-c0aa011c9bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.161276 Oct 19 13:17:41.834406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 185/399] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:42.862027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:42.862603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:42.869963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:42.870447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:42.870908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:42.871583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:42.872025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:42.872474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:43.006934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:43.020644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:43.023103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:43.024899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-814f0db8-49ee-4e56-a412-c3c845a3ea82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.168153 Oct 19 13:17:43.025539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 215/400] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:43.713023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ee40a8a-1a88-45e5-a7ae-6dd32e82bf17"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:43.716789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:43.725900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:43.726376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:43.726799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:43.727481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:43.727918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:43.728331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:44.057455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:44.058468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:44.070311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:44.071110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:44.071833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:44.073024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:44.073784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:44.074494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:44.222039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:44.235411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:44.237672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:44.238831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9190ba48-8951-40ee-a499-00287352cda3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.188147 Oct 19 13:17:44.239399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 216/401] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:17:45.267764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:45.268791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:45.280406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:45.281353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:45.282072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:45.283195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:45.283941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:45.284636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:45.415120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:45.424160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:45.425943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:45.427927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-03aeb5da-5109-4965-a191-2d4c69e66823 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.166452 Oct 19 13:17:45.428731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 217/402] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:46.460093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:46.460896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:46.468819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.469415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.469916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.470715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.471241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.471736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.619089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:46.628045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:46.629609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:46.630773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-16f26972-cf53-4b6a-af51-9c3c263acbf2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.176216 Oct 19 13:17:46.631353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 218/403] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:46.635801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:17:46.638036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:46.643731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.644223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.644659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.645416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.645872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.646293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.721878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4af39f78-7d45-4856-8497-0784f969c260 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.089324 Oct 19 13:17:46.725700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 219/404] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:17:46 2022] POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:17:46.730912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:46.731604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:46.738105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.738705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.739158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.739886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:46.740345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:46.740805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:46.744890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:46.894183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:46.904565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6ad49a23-95d2-45db-829d-f88164700e71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.177526 Oct 19 13:17:46.905175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 220/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:47.660787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:47.661693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:47.670306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:47.670882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:47.671438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:47.672346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:47.672910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:47.673481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:47.810390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:47.819323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:47.820755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:47.821941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52c165c6-4980-4474-a439-ec8043fe422c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.168544 Oct 19 13:17:47.822491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 221/406] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:47.930937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:47.931548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:47.938056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:47.938541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:47.938974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:47.939673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:47.940126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:47.940552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:48.095997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:48.105608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-db098b8e-d63c-40a7-8ed7-62fb2800004a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.178607 Oct 19 13:17:48.106183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 222/407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:17:48.849863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:48.850580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:48.857481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:48.857958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:48.858388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:48.859070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:48.859513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:48.859929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:49.002351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:49.011369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:49.012792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:49.013955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a48f01fa-9bc2-4dd8-b8f8-3c8111ab5eef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.169436 Oct 19 13:17:49.014538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 223/408] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:49.132081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:49.132727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:49.140500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:49.141146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:49.141679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:49.142531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:49.143088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:49.143613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:49.303968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:49.312600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ac03967c-b7ed-43e2-847d-1c4e4525e2b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.186146 Oct 19 13:17:49.316899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 224/409] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:17:50.040134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:50.040764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:50.047497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:50.047979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:50.048405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:50.049128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:50.049577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:50.049976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:50.191344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:50.200787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:50.202266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:50.203431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b8e2ea7d-eb0a-4978-bade-86795df2cc0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.167454 Oct 19 13:17:50.203997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 225/410] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:50.335939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:50.336579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:50.338509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=42 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:50.344650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:50.345158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:50.345588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:50.346282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:50.346726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:50.347141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:50.495832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:50.506355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ece50e2-b0dc-4fec-8094-20cc55ebebc4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.174542 Oct 19 13:17:50.507122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 226/411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:51.234593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:51.235669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:51.246673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:51.247519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:51.248232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:51.249413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:51.250171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:51.250907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:51.391469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:51.401421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:51.402840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:51.404013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0ac7a2cc-20e6-48e7-a3bd-d80572b8dbfa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.176181 Oct 19 13:17:51.404989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 227/412] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:51.533569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:51.534565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:51.544926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:51.545745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:51.546484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:51.547612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:51.548355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:51.549091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:51.700930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:51.712084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d819dae3-8a43-4852-bfdb-33658e208272 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.185121 Oct 19 13:17:51.712622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 228/413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:52.431851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:52.432684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:52.441532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:52.442630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:52.443256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:52.444224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:52.444853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:52.445503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:52.589396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:52.598091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:52.599568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:52.600720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a2c40a48-dc0d-4e0b-8b0d-fc81c5a708db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.173961 Oct 19 13:17:52.601312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 229/414] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:52.740116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:52.741165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:52.751282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:52.752104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:52.752837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:52.754201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:52.754707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:52.755594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:52.911176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:52.919499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-57272419-8d83-4966-8eaa-a611c366c146 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.186301 Oct 19 13:17:52.920069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 230/415] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:53.626175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:53.626849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:53.633944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:53.634431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:53.634872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:53.635563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:53.636018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:53.636443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:53.724892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=7 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:53.773989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:53.782703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:53.784117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:53.785302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39d027a4-c258-4f89-9e08-7c8f3d3063b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.163123 Oct 19 13:17:53.785978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 231/416] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:17:53.806024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=47 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:53.943514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:53.944151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:53.950544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:53.951032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:53.951470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:53.952164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:53.952619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:53.953085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:54.108895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:54.121115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-efc78913-351c-4735-ad00-a96afa43de38 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.181200 Oct 19 13:17:54.121889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 232/417] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:54.814881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:54.816103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:54.823759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:54.824245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:54.824680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:54.825403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:54.825859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:54.826281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:54.971340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:54.982245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:54.983714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:54.984906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-82daa8b1-b615-4db1-b283-49cad08d03de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.176661 Oct 19 13:17:54.985466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 233/418] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:55.151954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:55.152843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:55.162389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:55.162880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:55.163321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:55.164017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:55.164473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:55.164908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:55.316224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:55.324852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3651b47f-fcb3-4f05-92bf-555c11411103 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.179744 Oct 19 13:17:55.325452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 234/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:56.013179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:56.013881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:56.023968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:56.024448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:56.024937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:56.025622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:56.026068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:56.026481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:56.173388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:56.183376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:56.184816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:56.186015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2564925f-8df6-4849-9c74-002b13175a5f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.179307 Oct 19 13:17:56.186583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 235/420] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:56.351491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:56.352108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:56.358593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:56.359081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:56.359524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:56.360220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:56.360674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:56.361136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:56.519988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:56.523159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:17:56.530524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b9e07f79-97e3-418e-bc83-4599ba7f9d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.185019 Oct 19 13:17:56.531095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 236/421] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:57.213348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:57.214262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:57.223005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:57.223647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:57.224220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:57.225438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:57.225891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:57.226309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:57.357527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:57.366305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:57.367719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:57.368892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c499df1b-94c2-4258-9a08-28d002c77e8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.161119 Oct 19 13:17:57.369460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 237/422] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:57.555285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:57.555891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:57.562028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:57.562503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:57.562932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:57.563611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:57.564059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:57.564473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:57.730702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:57.739055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5856e729-2702-48aa-a2be-853b23e2ee3c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.188297 Oct 19 13:17:57.739635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 238/423] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:58.397833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:58.398474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:58.405306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:58.405782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:58.406216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:58.406904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:58.407340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:58.407763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:58.540735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:58.549905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:58.551336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:58.552500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-36ea6433-2f7b-4264-96a3-581ada008dce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.160829 Oct 19 13:17:58.553119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 239/424] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:58.766627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:58.767616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:58.776254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:58.776733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:58.777196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:58.777892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:58.778344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:58.778768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:58.930937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:58.939166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e16870fd-735f-4be5-8532-ac08832247ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.178915 Oct 19 13:17:58.939725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 240/425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:17:59.589443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:59.590094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:59.597088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:59.597577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:59.598014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:59.598704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:59.599133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:59.599566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:59.743490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:59.758077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:59.759694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:17:59.761394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b98a15c2-835e-429c-a4fd-c9040808bef2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.176213 Oct 19 13:17:59.762196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 241/426] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:17:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:17:59.964271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:17:59.965298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:17:59.975816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:59.976673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:59.977233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:17:59.977946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:17:59.978401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:17:59.978828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:00.153799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:00.166490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c908a2c6-b4d7-42a5-8df9-77c15290f2e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.206949 Oct 19 13:18:00.167407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 242/427] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:17:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:00.788102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:00.788839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:00.796220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:00.796705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:00.797181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:00.797879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:00.798330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:00.798752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:00.940095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:00.949040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:00.950504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:00.951723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8fb28e4c-9256-4b71-b20e-aa20d9835c28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.167697 Oct 19 13:18:00.952320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 243/428] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:01.194153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:01.194793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:01.202169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:01.202659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:01.203094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:01.203792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:01.204247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:01.204668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:01.358004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:01.366634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-547b57c5-e54a-49a0-a839-824b9f6782b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.178339 Oct 19 13:18:01.367235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 244/429] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:01.981396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:01.982284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:01.990667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:01.991274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:01.991872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:01.992729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:01.993540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:01.993940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:02.131785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:02.140605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:02.142051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:02.143200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75a4e3ae-e3cd-4c82-8af5-704e3b5374b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.167641 Oct 19 13:18:02.143756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 245/430] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:02.392400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:02.392615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:02.400455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:02.400953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:02.401404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:02.402108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:02.402555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:02.402973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:02.557538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:02.566737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9bee9b6a-a9f0-401a-abc0-f45e10c3346b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.178841 Oct 19 13:18:02.567635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 246/431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:03.170330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:03.170911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:03.177908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:03.178522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:03.178803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:03.179481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:03.179929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:03.180334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:03.310646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:03.319446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:03.320883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:03.322204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f1118d8-b2f1-4a5c-abcf-444c534f3e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.155991 Oct 19 13:18:03.322773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 247/432] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:03.594695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:03.595727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:03.605262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:03.605747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:03.606180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:03.606907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:03.607358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:03.607780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:03.756054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:03.768606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-23bbc729-18d7-4a2a-ba75-533b7a2227c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.180268 Oct 19 13:18:03.769471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 248/433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:04.347886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:04.348502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:04.355626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:04.356106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:04.356565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:04.357283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:04.357738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:04.358156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:04.492504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:04.501832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:04.503300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:04.504461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e5b75416-e04b-405a-a0c5-f5a6ec47a0bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.160573 Oct 19 13:18:04.505236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 249/434] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:04.798432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:04.799421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:04.808899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:04.809409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:04.809845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:04.810544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:04.811003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:04.811427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:04.972368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:04.983586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5fd89cc-e078-4f5c-95da-07dd4daa99f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.192350 Oct 19 13:18:04.984169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 250/435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:05.533896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:05.534785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:05.544772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:05.545530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:05.546205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:05.547240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:05.547836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:05.548452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:05.693631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:05.704030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:05.705491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:05.706676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9d2ca207-d7c0-41f6-93d6-eff1e7d8b06d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.178830 Oct 19 13:18:05.707235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 251/436] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:06.007648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:06.008365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:06.015971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:06.016502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:06.017022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:06.017784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:06.018288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:06.018762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:06.166736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:06.179987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9ce332c2-cdfd-48b2-b90a-f72c491d4316 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.176526 Oct 19 13:18:06.180843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 252/437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:06.737045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:06.738170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:06.748050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:06.748537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:06.748993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:06.749680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:06.750125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:06.750554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:06.765858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:06.887789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:06.897523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:06.899035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:06.900180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f2ab894e-9a81-4298-b5f0-34a29a63e508 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.170922 Oct 19 13:18:06.900993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 253/438] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:18:07.207369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:07.208321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:07.218525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:07.219317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:07.220022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:07.221213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:07.221959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:07.222655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:07.381308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:07.390095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bc648b4b-b643-4941-9db8-d8127b1ab65e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.189295 Oct 19 13:18:07.390642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 254/439] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:07.926315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:07.926957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:07.934145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:07.934625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:07.935059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:07.935760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:07.936211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:07.936633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:08.091086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:08.104519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:08.106552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:08.107725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-94299205-da05-45fb-8f3c-c582c66fee41 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.185585 Oct 19 13:18:08.108297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 255/440] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:08.419157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:08.420056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:08.429498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:08.430186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:08.430806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:08.431804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:08.432476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:08.433098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:08.574998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:08.584020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9b44e653-f5ac-416e-a3ab-2ffef897b53e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.171143 Oct 19 13:18:08.584598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 256/441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:18:09.137672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:09.138528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:09.147837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:09.148470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:09.149108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:09.150019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:09.150625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:09.151184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:09.288395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:09.298003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:09.299422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:09.300581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7d4d5cd1-6eee-45f6-8bfb-7e88a7acade6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.168779 Oct 19 13:18:09.301327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 257/442] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:09.610726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:09.611329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:09.617985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:09.618496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:09.618914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:09.619598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:09.620376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:09.620541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:09.776726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:09.785582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-77e13443-b304-4e81-9cd8-6c48cf9c0931 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.178783 Oct 19 13:18:09.786126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 258/443] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:10.327201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:10.327932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:10.335033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:10.335514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:10.335952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:10.336641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:10.337208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:10.337616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:10.482079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:10.495160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:10.497446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:10.499587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2ee9e1c7-cf18-4fdd-9a44-844055aa399e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.176467 Oct 19 13:18:10.500304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 259/444] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:10.813762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:10.814758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:10.824637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:10.825164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:10.825590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:10.826306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:10.826757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:10.827172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:10.985418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:10.994030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-06f438b6-0250-48fd-9a04-ce9e193c3f2f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.186968 Oct 19 13:18:10.994602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 260/445] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:11.528984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:11.529678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:11.536493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:11.537012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:11.537443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:11.538133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:11.538577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:11.539000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:11.677218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:11.686781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:11.688381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:11.689595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-92095c99-91b6-4169-8392-eb05df9ca6c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.166929 Oct 19 13:18:11.690167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 261/446] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:12.022371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:12.023375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:12.031685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:12.032177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:12.032613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:12.033414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:12.033862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:12.034284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:12.178982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:12.187784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8bfe04a4-eebc-4edc-8c8d-e61ffa1f6007 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.172283 Oct 19 13:18:12.188370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 262/447] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:12.717825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:12.718422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:12.725543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:12.726033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:12.726617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:12.727334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:12.727795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:12.728215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:12.869497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:12.879426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:12.880846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:12.882022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6d439ecb-7892-4140-8811-e3810fb9244c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.169564 Oct 19 13:18:12.882552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 263/448] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:13.222996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:13.223825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:13.232794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:13.233319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:13.233759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:13.234456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:13.234913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:13.235340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:13.390112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:13.404171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-47109f0b-2d01-4dee-8769-437f4fd8201e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.186363 Oct 19 13:18:13.405106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 264/449] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:13.908182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:13.908821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:13.916045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:13.916540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:13.917018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:13.917751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:13.918207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:13.918633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:13.936034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f72a0367-b941-4375-96ef-6db10a5648f7 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "POST /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 30.229788 Oct 19 13:18:13.936952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 186/450] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:17:43 2022] POST /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de/os-volume_attachments => generated 194 bytes in 30232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:18:14.052287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:14.066572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:14.068799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:14.070625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-80c28b71-fa9f-44bc-8248-d9ce645bb3d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.166654 Oct 19 13:18:14.071455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 265/451] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:18:14.430266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:14.431342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:14.439778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:14.440254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:14.440674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:14.441382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:14.441827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:14.442241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:14.591584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:14.600615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-18a56ae1-55c4-4909-aded-bdac7eb9ee3a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1752 microversion: 2.1 time: 0.176219 Oct 19 13:18:14.601214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 187/452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:14.993900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:18:15.001346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.001926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.002381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.064148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Going to try to stop instance {{(pid=118983) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 13:18:15.099372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:15.100084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:15.107049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.107658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.108093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.108882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.109341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.109753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.111304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bbcc7131-8c2c-4aee-88c0-48724ac9e49c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action" status: 202 len: 0 microversion: 2.1 time: 0.121194 Oct 19 13:18:15.112124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 266/453] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:18:14 2022] POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:18:15.121119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:15.121822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:15.128403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.128942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.129397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.130232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.130696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.131122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.246118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:15.259854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:15.262163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:15.263627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1402dc5-61f9-4cea-9aae-bcf9c22523bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.168203 Oct 19 13:18:15.264367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 188/454] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:15.270537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:15.279318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74b18eee-9355-49c2-b2be-5a7998dbe986 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.162234 Oct 19 13:18:15.279847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 267/455] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:18:15.624323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:15.625162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:15.631491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.631963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.632388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.633093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:15.633532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:15.633942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:15.791445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:15.800534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-458a38e1-f5a3-490a-af80-5faf3f1d5da8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.180278 Oct 19 13:18:15.816486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 189/456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:16.295269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:16.296018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:16.303145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:16.303660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.303924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.304351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.304469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:16.305072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.305606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.306065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.310640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.311166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.311719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.312619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.313099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.313521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.450492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:16.450674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:16.459608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c8f1262f-9c0e-4873-9ec4-ec6a3fe0b2d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.160608 Oct 19 13:18:16.459813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:16.460513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 190/457] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:16.461247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:16.462492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9f177a28-e1bd-4039-9156-64bec6bac00c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1807 microversion: 2.20 time: 0.177265 Oct 19 13:18:16.463111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 268/458] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:16.827222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:16.827864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:16.834459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.834945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.835369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.836052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:16.836483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:16.836896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:16.991015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:17.000113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3b9bead0-424b-4cb3-a6e6-c313b004ae06 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.179221 Oct 19 13:18:17.000685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 191/459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:17.485580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:17.486157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:17.488318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:17.488979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:17.492953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:17.493444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:17.493881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:17.494592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:17.495028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:17.495318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:17.495421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:17.495798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:17.496220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:17.496942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:17.497396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:17.498002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:17.501145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:17.628428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:17.634717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:17.637644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:17.639772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:17.641001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e56a7f1-0001-492e-8c94-bb7ff58c18ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1794 microversion: 2.20 time: 0.156538 Oct 19 13:18:17.641564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 192/460] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:18:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:18:17.643308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-32674c95-2fe4-45ac-9459-330211cd3c5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.163323 Oct 19 13:18:17.643859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 269/461] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:18.028543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:18.029792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:18.036723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:18.037244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:18.037671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:18.038354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:18.038801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:18.039216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:18.201205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:18.213251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-16ed8b99-09bf-495a-9cd1-d102c0c2a607 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.190979 Oct 19 13:18:18.213826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 193/462] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:18.667041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:18.667614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:18.674747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:18.675167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:18.675598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:18.676449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:18.676977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:18.677487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:18.819248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:18.832940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8e1d4fee-593a-4152-81f6-9f946b5bd439 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.169716 Oct 19 13:18:18.833710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 270/463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:19.238677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:19.239240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:19.246088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:19.246598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:19.247033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:19.247723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:19.248173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:19.248566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:19.392213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:19.406157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d1621b0-4dca-45b1-b0fb-b982abf688f1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.171551 Oct 19 13:18:19.406736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 194/464] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:18:19.859960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:19.860604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:19.867733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:19.868238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:19.868688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:19.869442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:19.869916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:19.870354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:20.013517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:20.022402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-319e0534-7da2-4945-bf92-52663dcaf840 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.166601 Oct 19 13:18:20.022962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 271/465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:20.433372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:20.433992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:20.441937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:20.442436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:20.442900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:20.443596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:20.444050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:20.444470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:20.594634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:20.608248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-186aebce-2030-4872-8bd7-19e7ce27093e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.180804 Oct 19 13:18:20.609094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 195/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:21.048703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:21.049393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:21.053064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=92 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:21.061375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:21.062031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:21.062952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:21.063766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:21.064232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:21.064665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:21.211219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:21.224005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-458110e1-15be-4ebd-ba9f-7efae83de8c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.181264 Oct 19 13:18:21.224819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 272/467] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:21.637361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:21.638324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:21.649740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:21.650533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:21.651244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:21.652374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:21.653163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:21.653851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:21.804190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:21.814564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-594a02fc-0a9f-42bd-aaf4-741f38d11ea5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.184557 Oct 19 13:18:21.815179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 196/468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:22.254922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:22.256121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:22.266939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:22.267425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:22.267862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:22.268557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:22.269043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:22.269465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:22.399899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:22.408963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-21c1f3bc-677d-4471-a963-802ccf018835 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.161557 Oct 19 13:18:22.409566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 273/469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:22.842516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:22.843532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:22.854644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:22.855477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:22.856225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:22.857423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:22.858209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:22.858891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:23.006368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:23.017760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9ee49e33-9102-4245-ad9b-df86e884a55c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.181857 Oct 19 13:18:23.018334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 197/470] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:23.431935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:23.432487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:23.440227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:23.440902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:23.441385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:23.442187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:23.442648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:23.443077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:23.630651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:23.647533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ed1ed72-c1f1-44e8-a3b3-2834b2851f60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.219571 Oct 19 13:18:23.648293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 274/471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:24.041610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:24.042228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:24.049146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:24.049631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:24.050057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:24.050755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:24.051235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:24.051617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:24.208332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:24.216762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3f940ecf-15c5-4a93-ab82-e9772721a4ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.179096 Oct 19 13:18:24.217347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 198/472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:24.671694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:24.672672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:24.680412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:24.680916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:24.681349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:24.682037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:24.682501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:24.682900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:24.817740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:24.826246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5b497de0-2f34-4a9b-891c-4efd1202e424 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.158429 Oct 19 13:18:24.826800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 275/473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:25.239789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:25.240358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:25.247253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:25.247724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:25.248142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:25.248821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:25.249302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:25.249713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:25.402269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:25.410974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bde3ee6e-6bde-4c9a-85ca-be6dd28dada5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.175016 Oct 19 13:18:25.411448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 199/474] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:25.849675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:25.850278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:25.857144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:25.857625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:25.858046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:25.858737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:25.859179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:25.859593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:25.993022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:26.004307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-15ac95f5-f547-4ab9-abe8-ce1a7adfcc82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.158525 Oct 19 13:18:26.004889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 276/475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:26.436627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:26.437442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:26.445140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:26.445552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:26.445981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:26.446675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:26.447119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:26.447539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:26.602473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:26.611512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-27f488b2-cee9-4bfd-9f69-f139347fa8c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.180347 Oct 19 13:18:26.612092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 200/476] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:27.031827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:27.032975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:27.044012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:27.044810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:27.045606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:27.046754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:27.047523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:27.047953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:27.185265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:27.194914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5d78edbd-1fe5-4e7c-866c-9ad3349e800d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.169491 Oct 19 13:18:27.195482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 277/477] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:27.639363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:27.640320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:27.648298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:27.648773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:27.649240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:27.649922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:27.650364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:27.650772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:27.795278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:27.804079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f147f873-8500-42cf-915f-0acdef16113c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.171413 Oct 19 13:18:27.804637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 201/478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:28.221933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:28.222546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:28.230387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:28.230948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:28.231452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:28.232260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:28.232790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:28.233339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:28.374017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:28.386182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52dbebbf-2870-4f13-abb6-2bcfe8d14d99 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.169991 Oct 19 13:18:28.386988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 278/479] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:28.831743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:28.832653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:28.843665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:28.844442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:28.845165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:28.845890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:28.846608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:28.847029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:28.851231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:28.994181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:29.005531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7e5f9ca2-bc08-465f-bd7a-0291b42c123f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.180326 Oct 19 13:18:29.006099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 202/480] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:29.417557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:29.418487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:29.429912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:29.430749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:29.431485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:29.432593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:29.433425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:29.434104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:29.575660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:29.588213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-53bf8851-45e1-4fec-85ce-8737a3432c3f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.177100 Oct 19 13:18:29.589047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 279/481] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:30.034721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:30.035618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:30.046147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:30.046831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:30.047553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:30.048761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:30.049283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:30.049707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:30.409933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:30.418400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a6408cb3-b3e1-4012-9c3e-31a84976d067 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.390194 Oct 19 13:18:30.418993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 203/482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:30.614277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:30.614842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:30.622045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:30.622604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:30.623080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:30.623864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:30.624365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:30.624829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:30.762118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:30.771481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-02c6f233-0fd2-41d5-9241-1f6b2fa7f1d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1725 microversion: 2.1 time: 0.163144 Oct 19 13:18:30.772045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 280/483] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:31.441870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:31.442420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:31.449157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:31.449630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:31.450051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:31.450710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:31.451149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:31.451554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:31.599413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:31.607803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ddc1f41b-fe88-4622-b3d3-ecec242ab09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.169901 Oct 19 13:18:31.608307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 204/484] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:31.799323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:31.800293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:31.807783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:31.808263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:31.808696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:31.809418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:31.809869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:31.810284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:31.944065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:31.952402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce9ea3ef-5060-4558-a8e0-7fe0dfae9554 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1702 microversion: 2.1 time: 0.159588 Oct 19 13:18:31.952982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 281/485] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:31.974970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:18:31.981581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:31.982086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:31.982539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:32.055606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Going to try to start instance {{(pid=118982) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 13:18:32.107707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6eeb4f13-c0a1-48b8-af3a-398ddeea0804 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action" status: 202 len: 0 microversion: 2.1 time: 0.136887 Oct 19 13:18:32.108413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 205/486] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:18:31 2022] POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:18:32.117330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:32.117938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:32.123928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:32.124411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:32.124846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:32.125555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:32.126002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:32.126420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:32.578240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:32.587652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-be483e4b-ff2a-48de-bc8e-1eb1cb22d3d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1711 microversion: 2.1 time: 0.474237 Oct 19 13:18:32.588310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 282/487] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1711 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:32.632591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:32.633399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:32.639775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:32.640318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:32.640751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:32.641464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:32.641908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:32.642317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:32.787750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:32.796673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d18cab4d-f738-46fb-b940-8a1f401c4311 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.168978 Oct 19 13:18:32.797314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 206/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:33.611439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:33.612001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:33.619147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:33.619633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:33.620066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:33.620755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:33.621235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:33.621648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:33.776462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:33.785756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4e6954e3-0c31-4ddf-bf0d-68ce29a1581d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1711 microversion: 2.1 time: 0.178118 Oct 19 13:18:33.786373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 283/489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1711 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:33.819917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:33.820745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:33.827585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:33.828062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:33.828482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:33.829282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:33.829757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:33.830272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:33.978460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:33.986939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d41badf-d99b-49f7-9a1e-22afb5573dfe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.171143 Oct 19 13:18:33.987507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 207/490] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:34.809069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:34.809747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:34.817579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:34.818095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:34.818555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:34.819288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:34.819765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:34.820205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:34.966959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:34.975965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d8e08b33-5a5e-4d9c-8745-213128534f76 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1715 microversion: 2.1 time: 0.171017 Oct 19 13:18:34.976540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 284/491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:35.013534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:35.014356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:35.024810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:35.025469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:35.026054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:35.027099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:35.027693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:35.028307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:35.208204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:35.221098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-232b61ae-820f-4cca-8f58-e1b2863bf61e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.213515 Oct 19 13:18:35.221862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 208/492] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:36.246391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:36.246962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:36.253849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:36.254572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:36.255003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:36.255691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:36.256142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:36.256548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:36.403421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:36.405681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:36.413561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-305a9b54-b040-4323-af52-fb6650dd0662 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1757 microversion: 2.1 time: 0.171967 Oct 19 13:18:36.414132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 285/493] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:37.441520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:37.442661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:37.449822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:37.450300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:37.450729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:37.451395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:37.451865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:37.452287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:37.597996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:18:37.606985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ec2f4ed0-fd8b-4343-8bed-0c9e22e7b147 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1760 microversion: 2.1 time: 0.172166 Oct 19 13:18:37.607525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 209/494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:18:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:18:51.183009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:51.183787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:51.186398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=27 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:51.187193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:51.195828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.196431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.197020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.197899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.198458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.199021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.233575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-79603cab-1976-4dcf-8889-e0dde9b47821 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments/c605cae0-5390-4e87-a5d3-70e96905cfda" status: 200 len: 194 microversion: 2.20 time: 0.055810 Oct 19 13:18:51.234160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 286/495] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Oct 19 13:18:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments/c605cae0-5390-4e87-a5d3-70e96905cfda => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:51.308170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:51.308854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:51.312390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=46 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:51.313059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:18:51.316849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.317375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.317804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.318666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.319114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.319526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.445492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lazy-loading 'services' on Instance uuid 26717ab1-6c97-4d22-afe6-d00760711621 {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:18:51.569089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3f454609-dba7-407b-9651-f03861c28528 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments/c605cae0-5390-4e87-a5d3-70e96905cfda" status: 202 len: 0 microversion: 2.20 time: 0.264797 Oct 19 13:18:51.569780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 210/496] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Oct 19 13:18:51 2022] DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments/c605cae0-5390-4e87-a5d3-70e96905cfda => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:18:51.578326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:51.580628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:51.587754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.588248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.588723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.589560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:51.590047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:51.590530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:51.623984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a5043f7c-5c9d-4a46-827c-a76defb4f6e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049707 Oct 19 13:18:51.624583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 287/497] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:52.643226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:52.647047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:52.653762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:52.654239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:52.654664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:52.655346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:52.655789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:52.656207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:52.689956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c930dec-d13f-48b2-b12c-dea5d18be455 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054750 Oct 19 13:18:52.690523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 211/498] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:53.707430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:53.710984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:53.721806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:53.722634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:53.723324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:53.724503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:53.725006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:53.725428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:53.755005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb8863a2-da75-4a29-afa9-7f722a532095 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054229 Oct 19 13:18:53.755739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 288/499] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:54.775065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:54.778612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:54.789208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:54.789683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:54.790109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:54.790793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:54.791231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:54.791646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:54.822567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0c4bff4a-3ad9-4f12-a0ca-7b7530de614b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055260 Oct 19 13:18:54.823102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 212/500] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:55.835504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:55.837839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:55.844741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:55.845274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:55.845704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:55.846399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:55.846850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:55.847271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:55.877309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7a3fd1ae-f889-4ba5-9173-d405a13da269 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045904 Oct 19 13:18:55.877858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 289/501] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:56.890427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:56.892771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:56.900530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:56.901038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:56.901513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:56.902373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:56.902890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:56.903373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:56.935013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f9e19b58-9b42-4dc2-9982-bb1f285d0dc7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048613 Oct 19 13:18:56.935580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 213/502] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:57.947979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:57.950209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:57.957400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:57.957881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:57.958313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:57.959006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:57.959454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:57.959868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:57.990152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ac9093ea-f888-4e4e-baa5-031e1c7ada2e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046268 Oct 19 13:18:57.990748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 290/503] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:18:59.005728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:18:59.008530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:18:59.015244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:59.015720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:59.016141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:59.016838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:18:59.017306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:18:59.017716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:18:59.048541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-628aab84-906d-482e-b26b-dac5949193ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049151 Oct 19 13:18:59.049124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 214/504] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:18:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:00.064436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:00.067804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:00.078056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:00.078771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:00.079392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:00.080461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:00.081057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:00.081707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:00.112970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78c69e24-4e25-4d49-94cc-1e37c8e26e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054880 Oct 19 13:19:00.113465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 291/505] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:01.126850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:01.129072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:01.135907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:01.136388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:01.136816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:01.137528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:01.137975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:01.138394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:01.171570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4d71703e-6886-4ef6-bd45-2acf5a395b82 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048588 Oct 19 13:19:01.172418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 215/506] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:02.186811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:02.189194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:02.196538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:02.197044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:02.197482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:02.203897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:02.203897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:02.203897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:02.235790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0df508d4-8c2d-4bd6-bfff-e6a1d867356e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053184 Oct 19 13:19:02.236385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 292/507] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:03.247924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:03.250279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:03.257148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:03.257651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:03.258048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:03.258913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:03.259352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:03.259762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:03.291642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9accb7af-6e24-41a4-8a26-cbbd24ccf6d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047469 Oct 19 13:19:03.292205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 216/508] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:04.304025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:04.306254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:04.312888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:04.313397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:04.313829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:04.314507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:04.315149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:04.316029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:04.346920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-80270c8a-850c-4908-af71-e4e3a2d18de6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046955 Oct 19 13:19:04.347736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 293/509] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:05.359701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:05.362097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:05.369310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:05.369792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:05.370223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:05.370921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:05.371368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:05.371786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:05.405291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa8f7265-6eab-43e4-8b09-6aa2f9777c9b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049528 Oct 19 13:19:05.405849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 217/510] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:06.419049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:06.421236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:06.428055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:06.428541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:06.429014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:06.429718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:06.430171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:06.430854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:06.463813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e578bc3b-edd7-4f07-a9f1-b7e01e824c8d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049310 Oct 19 13:19:06.464386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 294/511] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:07.479784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:07.481956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:07.488743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:07.489249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:07.489683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:07.490372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:07.490817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:07.491230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:07.522771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-edaea6d7-bb57-480a-8933-8ed149377de4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049591 Oct 19 13:19:07.523615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 218/512] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:08.537993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:08.540679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:08.549037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:08.549643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:08.550184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:08.551043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:08.551603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:08.554153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:08.598176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-05f95a05-e100-4989-89cd-d0538d49b310 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065393 Oct 19 13:19:08.598800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 295/513] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:09.612616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:09.615117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:09.622985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:09.623543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:09.624038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:09.624845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:09.625426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:09.625886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:09.658060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8f25ce77-d2f9-45b5-a362-0e7392fca643 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050153 Oct 19 13:19:09.662689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 219/514] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:10.675730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:10.679260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:10.686924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:10.687410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:10.687840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:10.688525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:10.689014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:10.689425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:10.721465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dc687f5c-ade5-47e2-a663-219c3186df6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052884 Oct 19 13:19:10.722039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 296/515] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:11.739047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:11.743232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:11.754410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:11.755191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:11.758385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:11.758385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:11.758385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:11.758385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:11.792602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9a6cec49-d890-48ed-bd89-744eb5b53682 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060590 Oct 19 13:19:11.793196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 220/516] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:12.808561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:12.811296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:12.818737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:12.819428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:12.819870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:12.821401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:12.821904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:12.822419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:12.854048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-40eeee71-02b5-4864-91a1-2401a5049413 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050658 Oct 19 13:19:12.859008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 297/517] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:13.443824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:13.444466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:13.453057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:13.453747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:13.454355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:13.455374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:13.456009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:13.456609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:13.544024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lazy-loading 'services' on Instance uuid 0101bf0a-6484-4009-a3af-b1fe8359e58a {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:19:13.624062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1b610ffb-7345-4f66-9515-32ac37d49606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments/cd2712ba-99ea-45f7-b7f3-d747ee33c9ac" status: 202 len: 0 microversion: 2.1 time: 0.185262 Oct 19 13:19:13.624682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 221/518] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:19:13 2022] DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments/cd2712ba-99ea-45f7-b7f3-d747ee33c9ac => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:19:13.866725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:13.869056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:13.876684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:13.877235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:13.877685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:13.878428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:13.878902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:13.879343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:13.912506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9947e801-7183-49b4-a35d-c46030afcb64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049996 Oct 19 13:19:13.913163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 298/519] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:14.931992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:14.935582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:14.943760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:14.944284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:14.944711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:14.945434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:14.945954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:14.946264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:14.976968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cdd5f405-fb84-4ad9-807f-4e57e8be2673 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053155 Oct 19 13:19:14.977545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 222/520] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:15.993947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:15.998357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:16.008160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:16.008915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:16.009633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:16.010706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:16.011355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:16.012065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:16.044635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b192731-61b3-48c0-aa80-e7cf42c39640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057509 Oct 19 13:19:16.045214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 299/521] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:16.116839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1282116389"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:19:16.117618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:16.126924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:16.127591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:16.128177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:16.129192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:16.129814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:16.130398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:16.437085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.network.security_group_api [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Removing security group 6bd5f6ff-c97a-47d9-800b-47b7a2c28c88 from port c4155421-8ec4-4ae0-beed-d2f66efefb43 Oct 19 13:19:16.768134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-893987c2-2f01-4cb2-9e04-1af1ab431ec7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action" status: 202 len: 0 microversion: 2.1 time: 0.656784 Oct 19 13:19:16.768598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 223/522] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:19:16 2022] POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:19:16.779651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:19:16.793479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:16.794244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:16.795345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:16.815579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] Creating event network-changed:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:19:16.828049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-2adacb18-190f-46de-bd6d-65cbd09b9d72 req-053f55f5-3a94-4481-842a-ec933e89c819 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052078 Oct 19 13:19:16.829862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 300/523] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:17.058009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:17.060114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:17.073328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:17.073814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:17.074433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:17.077014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:17.077626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:17.080003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:17.120507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab81384e-b959-4758-aac2-d0f46c574fba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066485 Oct 19 13:19:17.122715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 224/524] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:17.997988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:17.998568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:18.005699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.006182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.006617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.007315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.007767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.008188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.135400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:18.138691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:18.148961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.149589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.150117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.151016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.151623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.152104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.171825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:18.185985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f481c595-db48-45e4-b3ab-235be735a8d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055671 Oct 19 13:19:18.186590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 225/525] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:18.253699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lazy-loading 'services' on Instance uuid e1de460a-d49c-4426-b831-aea60f28e9aa {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:19:18.389575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-06133508-5947-4641-9248-68e4a361546b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments/d4ad7386-201d-41f1-a108-11867637f00d" status: 202 len: 0 microversion: 2.1 time: 0.395662 Oct 19 13:19:18.390174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 301/526] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:19:17 2022] DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments/d4ad7386-201d-41f1-a108-11867637f00d => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:19:18.399013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:18.401501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:18.408175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.408648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.409098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.409960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.410409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.410829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.445776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b91cdd4-d48d-4414-aae6-771856080ec6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050848 Oct 19 13:19:18.446526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 226/527] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:18.845246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:19:18.855349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:18.855837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:18.856315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:18.867847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] Creating event network-changed:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:19:18.872619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-98c68aa0-3ad2-4161-af23-ebffb532eac4 req-6bb21605-0b4e-465b-b733-7444b1cee2b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031774 Oct 19 13:19:18.873397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 302/528] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:19.199673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:19.201907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:19.208827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:19.209340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:19.209767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:19.210457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:19.210899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:19.211313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:19.241493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a5597755-d56f-4e07-99ea-0fb1b92efee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046263 Oct 19 13:19:19.242030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 227/529] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:19.464253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:19.467814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:19.474891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:19.475375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:19.475809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:19.476506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:19.476992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:19.477415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:19.481206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:19.508051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1abe7bac-5073-4c8d-bd1e-44f1ec3e05f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051803 Oct 19 13:19:19.508635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 303/530] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:20.258911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:20.262231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:20.273405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:20.274193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:20.274898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:20.276008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:20.276740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:20.277463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:20.309886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-efccfbb6-cad3-494e-adb0-0f7328134b4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057883 Oct 19 13:19:20.310660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 228/531] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:20.521494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:20.523644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:20.529701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:20.530210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:20.530644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:20.532072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:20.532527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:20.533258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:20.565357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-15d80df5-63a6-422d-ab89-d004fad74c3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048296 Oct 19 13:19:20.565913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 304/532] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:21.323232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:21.325401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:21.332926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:21.333583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:21.334217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:21.335186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:21.335806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:21.336419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:21.374517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d5006442-ff8f-4142-87e7-7280e2511077 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055239 Oct 19 13:19:21.374981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 229/533] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:21.577917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:21.580404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:21.582900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=39 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:21.588556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:21.589119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:21.589565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:21.603799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:21.603799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:21.603799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:21.625055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-090500dd-6e2c-43c9-baae-eec94f03bd74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050873 Oct 19 13:19:21.625510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 305/534] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:22.390474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:22.393720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:22.397431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=41 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:22.404109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:22.404643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:22.405136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:22.406081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:22.406591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:22.407238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:22.438035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cf48288a-ae09-4538-ba55-efa3f26629c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053082 Oct 19 13:19:22.438498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 230/535] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:22.637417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:22.639548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:22.646584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:22.647065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:22.647494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:22.648187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:22.648633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:22.649076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:22.679087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a7e4404-a706-4292-94b7-259526b20d01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Oct 19 13:19:22.679629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 306/536] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:23.455745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:23.457936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:23.464887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:23.465380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:23.465804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:23.466505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:23.466947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:23.467359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:23.497449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57b3929b-fafd-4ad5-be2e-f81eafa68fab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048508 Oct 19 13:19:23.497920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 231/537] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:23.691874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:23.694068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:23.700983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:23.701475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:23.701963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:23.702698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:23.703129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:23.703587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:23.735502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-14a636f2-fb76-44d9-89e2-a175cc0e7322 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 Oct 19 13:19:23.736191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 307/538] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:24.510727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:24.512892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:24.515310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:19:24.515449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:19:24.523293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:24.523776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:24.524204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:24.524926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:24.525405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:24.525831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:24.557760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c960493-a204-4bbf-886c-cfe79278885e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051081 Oct 19 13:19:24.558321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 232/539] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:24.748578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:24.750729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:24.753110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:19:24.753247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:19:24.761737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:24.762224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:24.762664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:24.763414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:24.763904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:24.764324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:24.801630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-73f0ab36-38aa-417c-8797-b371cdcc04aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056943 Oct 19 13:19:24.802193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 308/540] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:25.571454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:25.573661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:25.580403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:25.580905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:25.581355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:25.582054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:25.584177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:25.584697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:25.615712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6f18633a-3aa0-4132-897c-b40a35f15d7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048460 Oct 19 13:19:25.616288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 233/541] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:25.813829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:25.815975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:25.822883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:25.823295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:25.823722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:25.824408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:25.824850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:25.825305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:25.857918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec88cf92-5401-4ed1-96e7-100ffe6acf9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Oct 19 13:19:25.863201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 309/542] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:26.628002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:26.630284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:26.636921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:26.637406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:26.637838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:26.638671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:26.639118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:26.639535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:26.670884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dac8cba6-d961-45f6-b7ce-fc2569ebf597 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046801 Oct 19 13:19:26.671463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 234/543] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:26.870233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:26.872400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:26.879472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:26.880660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:26.881268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:26.882118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:26.882571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:26.882995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:26.920089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dcc7a989-8298-4981-8e18-154a7bf27498 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053846 Oct 19 13:19:26.920889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 310/544] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:27.800109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:27.802463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:27.808507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:27.809010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:27.809467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:27.810158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:27.810602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:27.811015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:27.841446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4f25c1a9-e333-4da5-b78c-f5d45620625d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160842 Oct 19 13:19:27.842003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 235/545] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:27.932911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:27.935073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:27.941963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:27.942303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:27.942880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:27.943571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:27.944017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:27.944413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:27.974379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-384169fd-a54a-4c25-adfa-1e1ca3bf1812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Oct 19 13:19:27.979087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 311/546] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:28.858885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:28.862390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:28.870193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:28.870669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:28.871088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:28.871770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:28.872208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:28.872619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:28.904563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7e471d0c-611b-42b0-9330-0eadbfecf197 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052501 Oct 19 13:19:28.905159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 236/547] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:28.991428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:28.995208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:29.000168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:19:29.000401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:19:29.007241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:29.007668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:29.008158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:29.008821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:29.009291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:29.009711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:29.040808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-440a4ea9-1e06-4adc-b77a-7dbeef5403c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056200 Oct 19 13:19:29.041397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 312/548] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:29.919733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:29.921861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:29.928963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:29.929445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:29.929867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:29.930548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:29.930986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:29.931428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:29.961617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dda61603-d38a-4353-8116-be96e5aee8e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Oct 19 13:19:29.962158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 237/549] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:30.056003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:30.058174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:30.065118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:30.065609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:30.066045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:30.066741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:30.067327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:30.067760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:30.099268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-72c5c755-4513-490c-a7e2-0ba50474903a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Oct 19 13:19:30.099860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 313/550] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:30.979256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:30.982541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:30.993040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:30.993513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:30.993939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:30.994617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:30.995055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:30.995465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:31.026890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9f73ab50-5745-4e22-8ab7-c14a95c1c530 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054652 Oct 19 13:19:31.027427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 238/551] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:31.115831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:31.118958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:31.128166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:31.128703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:31.129317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:31.130195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:31.130679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:31.131155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:31.161790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0ce813a0-c61c-4fb9-8ac6-b45652c1392a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052546 Oct 19 13:19:31.162359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 314/552] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:32.043117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:32.045565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:32.053645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:32.054195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:32.054672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:32.055631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:32.056180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:32.056662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:32.089588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6295a248-c219-4f29-ba09-8ed86c0d59ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052212 Oct 19 13:19:32.090130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 239/553] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:32.179257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:32.182747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:32.195603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:32.195603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:32.195603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:32.196297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:32.196699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:32.197141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:32.228986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba3a0d84-96ff-406f-94fa-8b9d56f2f2ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056584 Oct 19 13:19:32.229789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 315/554] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:33.106373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:33.109841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:33.120887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:33.121646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:33.122236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:33.123267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:33.123819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:33.124451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:33.162482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3be5f4c5-549a-4106-8741-f0a1f317ea75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063163 Oct 19 13:19:33.163026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 240/555] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:33.245053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:33.247430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:33.254323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:33.254807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:33.255237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:33.255929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:33.256351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:33.256796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:33.287056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-72ee8045-0f3f-45e8-af8c-918aebd339cd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Oct 19 13:19:33.287605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 316/556] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:34.175067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:34.177147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:34.183929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:34.184403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:34.184824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:34.185527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:34.185960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:34.186368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:34.217658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-967ab49e-cdbf-4be8-98e7-f8ea6f79c5e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046879 Oct 19 13:19:34.218221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 241/557] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:34.302744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:34.305576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:34.313894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:34.314389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:34.314827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:34.315704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:34.316365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:34.316590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:34.347967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4429cad-b931-421e-9b5f-ed64015cc79f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051610 Oct 19 13:19:34.348538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 317/558] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:35.233237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:35.238445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:35.246808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:35.247282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:35.247705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:35.248381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:35.248819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:35.249254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:35.252973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:35.280638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-602e46b0-1216-4af9-9f28-3bb95e6cac50 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052994 Oct 19 13:19:35.281236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 242/559] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:35.360264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:35.362478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:35.369448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:35.369925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:35.370353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:35.371042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:35.371478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:35.371892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:35.402630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8cabb7a3-88aa-494b-b665-77223afea29f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Oct 19 13:19:35.403211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 318/560] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:36.295133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:36.297327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:36.304665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:36.305177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:36.305602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:36.306293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:36.306736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:36.307157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:36.338452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-801bbda7-c314-4f27-a0b2-77473ce480be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048112 Oct 19 13:19:36.338986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 243/561] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:36.418745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:36.421192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:36.428765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:36.429334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:36.429828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:36.430592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:36.431119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:36.431561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:36.459090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:36.464278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dbb387ff-9e61-4609-a3f5-3b0164140872 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051760 Oct 19 13:19:36.465109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 319/562] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:37.351217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:37.353399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:37.360452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:37.360956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:37.361389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:37.362071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:37.362515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:37.362932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:37.400664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8a7e5f5c-17c0-4236-a1e1-1e25bdeeddce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053431 Oct 19 13:19:37.401200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 244/563] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:37.481750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:37.485220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:37.496690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:37.497251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:37.497690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:37.498389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:37.498927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:37.499354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:37.530036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ebc4ce85-5189-47c8-8d38-00b125f160b3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055512 Oct 19 13:19:37.530884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 320/564] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:38.417420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:38.421400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:38.432274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:38.433232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:38.433884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:38.434576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:38.435019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:38.435434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:38.465819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-44ee60b3-8436-45e2-bda2-bb4d5935ce46 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055235 Oct 19 13:19:38.466294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 245/565] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:38.545845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:38.547997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:38.554922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:38.555409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:38.555877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:38.556556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:38.557056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:38.557478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:38.587466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd444cee-d7e5-4250-a5e3-cc917399c541 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047077 Oct 19 13:19:38.588043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 321/566] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:39.482620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:39.485023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:39.492583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:39.493168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:39.493643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:39.494413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:39.494905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:39.495395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:39.531034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-52b10a00-0eb1-4000-b46a-d9f092d66dec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054700 Oct 19 13:19:39.531624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 246/567] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:39.603491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:39.606556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:39.613557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:39.614033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:39.614459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:39.615143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:39.615590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:39.616006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:39.648056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9759cc54-90e7-4e97-82cb-64f14a726f9d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051137 Oct 19 13:19:39.648619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 322/568] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:40.548624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:40.552360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:40.561938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:40.562421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:40.562856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:40.563540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:40.563958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:40.564381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:40.594437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d3cfc76-3f06-47b6-8ec0-af7a99088ab0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052675 Oct 19 13:19:40.594955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 247/569] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:40.664352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:40.667777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:40.678321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:40.679068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:40.679741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:40.680808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:40.681586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:40.682252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:40.716479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-80aca890-49d5-416d-9c0d-88da6fa98106 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058308 Oct 19 13:19:40.717044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 323/570] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:41.610906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:41.613730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:41.622056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:41.622666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:41.623329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:41.624074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:41.624628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:41.625184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:41.657784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-54778804-d642-4d13-8a39-882698fe04f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052821 Oct 19 13:19:41.658326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 248/571] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:41.733496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:41.735899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:41.743840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:41.744404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:41.744913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:41.745747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:41.746271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:41.746758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:41.779407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0d81c965-a462-4653-9e7f-ababe83c3fe8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052385 Oct 19 13:19:41.780173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 324/572] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:42.672131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:42.674488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:42.688689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:42.689186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:42.689614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:42.690302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:42.690740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:42.691149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:42.721210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a8b20048-40ad-44fb-a878-9a7800b2646d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053855 Oct 19 13:19:42.721748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 249/573] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:42.796433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:42.799997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:42.810564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:42.811121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:42.811550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:42.812235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:42.812676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:42.813115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:42.844689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ea11dfbb-c45b-4b6d-b05d-751e084922ba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055369 Oct 19 13:19:42.845402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 325/574] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:43.736477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:43.739060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:43.741292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:19:43.741478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:19:43.749357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:43.749860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:43.750335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:43.751100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:43.751601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:43.752101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:43.786539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c18d495-2f9c-46c3-9bb1-ebaf09370cb1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055083 Oct 19 13:19:43.787113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 250/575] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:43.862082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:43.865729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:43.877309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:43.878140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:43.878861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:43.880010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:43.881003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:43.881713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:43.915352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-148b8223-8c00-4c28-a8ef-dc38b535b457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060285 Oct 19 13:19:43.915959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 326/576] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:44.803549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:44.807014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:44.818452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:44.819236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:44.819937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:44.821123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:44.821864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:44.822552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:44.853818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00c573f6-87e8-42b6-988e-b1d288f3ab3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057089 Oct 19 13:19:44.854360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 251/577] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:44.932273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:44.935568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:44.942551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:44.943032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:44.943459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:44.944150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:44.944593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:44.945082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:44.975051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4656d56-5aef-4470-ae92-31439d88177d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049670 Oct 19 13:19:44.975596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 327/578] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:45.870942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:45.874033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:45.880876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:45.881400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:45.881819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:45.882482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:45.882922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:45.883335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:45.914815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1437fecf-62b4-4b77-ba2c-2653d370c27c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050730 Oct 19 13:19:45.915358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 252/579] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:45.992396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:45.996013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:46.007332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:46.008069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:46.008732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:46.009922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:46.010660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:46.011452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:46.043639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2908627b-213c-4ce9-be39-2e7de6c41e10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058394 Oct 19 13:19:46.044209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 328/580] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:46.928367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:46.930697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:46.937644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:46.938164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:46.938635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:46.939348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:46.939837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:46.940338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:46.979034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4c2f62e-6e56-4cfe-b31c-525232f7409e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054734 Oct 19 13:19:46.979617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 253/581] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:47.060925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:47.064472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:47.077391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:47.077391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:47.077711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:47.078368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:47.078823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:47.079246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:47.110879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-522bd0fa-9aba-4c76-b3d5-29429c63f6c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056731 Oct 19 13:19:47.111489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 329/582] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:47.996666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:47.999424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:48.006170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:48.006640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:48.007062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:48.007737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:48.008178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:48.008613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:48.038760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a21a1b98-5476-4451-bc44-7d574a5aa395 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048924 Oct 19 13:19:48.039302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 254/583] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:48.125000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:48.127103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:48.133985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:48.134468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:48.134907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:48.135574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:48.136058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:48.136485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:48.166606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5693f0ff-ee4b-4407-b5d0-e2ddba9963c9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Oct 19 13:19:48.167184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 330/584] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:49.055819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:49.059294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:49.071655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:49.072688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:49.073451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:49.074581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:49.075318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:49.076087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:49.108326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b990646f-c948-4cb9-bce8-d119010cf34d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059170 Oct 19 13:19:49.108897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 255/585] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:49.183901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:49.187363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:49.198460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:49.200104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:49.200104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:49.201137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:49.201583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:49.202022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:49.233457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d3c4b838-136e-4098-8c3d-823669d62db3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056355 Oct 19 13:19:49.234238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 331/586] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:50.125999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:50.128239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:50.135590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:50.136086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:50.136533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:50.137292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:50.137748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:50.138186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:50.170996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49083cc8-0091-47c9-999f-3da66de06851 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050746 Oct 19 13:19:50.171539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 256/587] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:50.249939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:50.252101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:50.258336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:50.258878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:50.259542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:50.259977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:50.260422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:50.260835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:50.292061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb885bb2-13d6-4360-8478-0bc0eb89f49a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048428 Oct 19 13:19:50.292657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 332/588] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:51.187594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:51.189779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:51.196641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:51.197144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:51.197565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:51.198225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:51.198658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:51.199071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:51.229388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1c4974be-d234-4c45-a670-93c6abe22623 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047846 Oct 19 13:19:51.229921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 257/589] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:51.306897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:51.309721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:51.318033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:51.318781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:51.319646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:51.319903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:51.320409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:51.320829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:51.351674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4e160b6-8a00-42e9-8abd-ebcdebf132db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049138 Oct 19 13:19:51.352350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 333/590] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:52.246563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:52.250260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:52.261355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:52.262153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:52.262925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:52.264240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:52.264963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:52.265391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:52.291511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:52.297257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-87b9ef87-0396-479c-83bd-fa62609e1d19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057478 Oct 19 13:19:52.297829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 258/591] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:52.369440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:52.372927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:52.375525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:52.381560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:52.382050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:52.382524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:52.383229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:52.383683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:52.384186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:52.415868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c05355d4-3f96-4aec-b886-840c533f3eae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053331 Oct 19 13:19:52.416454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 334/592] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:53.313476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:53.315670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:53.318336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:53.323704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:53.324196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:53.324620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:53.325324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:53.325767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:53.326184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:53.357279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4796fd8b-d317-457e-837a-bab9ec53bc0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049593 Oct 19 13:19:53.357841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 259/593] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:53.431749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:53.434542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:53.442396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:53.442895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:53.443338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:53.444047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:53.444504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:53.444935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:53.479214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7aeb740b-13e0-4687-bf34-ab130e88d0ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054060 Oct 19 13:19:53.479811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 335/594] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:54.374870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:54.378569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:54.389449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:54.390257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:54.390736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:54.391447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:54.391897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:54.392296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:54.424620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1a2115b6-226e-4f02-a207-6eae03ba16be tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056813 Oct 19 13:19:54.425202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 260/595] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:54.495984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:54.499488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:54.510671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:54.511655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:54.512353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:54.513319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:54.514066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:54.514962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:54.533239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:19:54.546337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60ca1bc3-3232-4bb4-8af9-36046df0ac46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056969 Oct 19 13:19:54.546887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 336/596] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:55.436775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:55.439181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:55.446155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:55.446635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:55.447064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:55.447751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:55.448195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:55.448610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:55.479154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d01166e-6da1-4043-b972-1635d7addf7c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046354 Oct 19 13:19:55.479734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 261/597] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:55.562546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:55.566215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:55.575392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:55.576033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:55.576604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:55.577599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:55.578333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:55.578769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:55.608515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ecd7cc41-0183-4b84-bcc1-5a8fc77f4c83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053200 Oct 19 13:19:55.609294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 337/598] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:56.497914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:56.501930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:56.512712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:56.513536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:56.514267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:56.515524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:56.516237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:56.516660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:56.549802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1a8988f2-a8e4-411b-bcfa-9ceaf95ffea8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058887 Oct 19 13:19:56.550364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 262/599] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:56.622072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:56.624214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:56.631102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:56.631609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:56.632038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:56.632972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:56.633202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:56.633617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:56.664596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2ac1a423-f4ce-4ca1-b810-0ebed98d3505 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Oct 19 13:19:56.665198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 338/600] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:57.567262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:57.569425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:57.576016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:57.576481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:57.576930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:57.577609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:57.578044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:57.578451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:57.609623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa137a65-3957-46d1-85ca-d2546dd399ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047099 Oct 19 13:19:57.610212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 263/601] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:57.681649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:57.685184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:57.693547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:57.694031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:57.694695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:57.695180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:57.695638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:57.696072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:57.726732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7559ac95-e566-44c6-b052-296720bc771d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051698 Oct 19 13:19:57.727292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 339/602] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:58.626876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:58.629013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:58.636127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:58.636601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:58.637070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:58.637754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:58.638198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:58.638615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:58.671119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-922addb7-cc6e-494e-aa7b-2dadcddebdba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050745 Oct 19 13:19:58.671820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 264/603] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:58.744732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:58.748283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:58.759391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:58.760414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:58.762163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:58.763496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:58.764269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:58.765539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:58.796530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-247a2fde-6dfb-48d4-98da-335f0ff49a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058516 Oct 19 13:19:58.797134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 340/604] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:19:59.687123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:59.689345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:59.696170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:59.696640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:59.697098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:59.697785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:59.698219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:59.698617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:59.737466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b43a0407-cebc-4df8-9804-6330639b0c4c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054297 Oct 19 13:19:59.738027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 265/605] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:19:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:19:59.811372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:19:59.814529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:19:59.821722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:59.822138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:59.822593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:59.823425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:19:59.823744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:19:59.824165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:19:59.854512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0f7d6dff-ac6c-45a9-96da-6c618e139e4c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048414 Oct 19 13:19:59.855100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 341/606] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:19:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:00.754257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:00.756647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:00.764176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:00.764722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:00.765166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:00.765907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:00.766398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:00.766937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:00.799018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d7858c16-f00c-4106-bbd2-a05ae0f3d151 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050658 Oct 19 13:20:00.799569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 266/607] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:00.871516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:00.875034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:00.882969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:00.883362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:00.883830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:00.884472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:00.884941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:00.885395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:00.917601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ef5950f5-74c6-4547-9cf2-c1de75759f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052933 Oct 19 13:20:00.918290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 342/608] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:01.814084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:01.817152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:01.826145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:01.826796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:01.827416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:01.828321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:01.828934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:01.829533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:01.859587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35161d48-6b71-4c91-adc9-c2e9d9859c25 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051026 Oct 19 13:20:01.860139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 267/609] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:01.930761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:01.933017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:01.940153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:01.940644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:01.941386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:01.941789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:01.942276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:01.942707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:01.973271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bdafab7a-1b6e-4151-8872-9e95ebaeff46 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046512 Oct 19 13:20:01.974136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 343/610] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:02.875975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:02.879788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:02.888299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:02.888923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:02.889473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:02.890351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:02.890924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:02.891460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:02.926062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-25004e40-c619-4e2d-a8ef-fb20ffc10023 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056790 Oct 19 13:20:02.926614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 268/611] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:02.989887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:02.993488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:03.004289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:03.004772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:03.005241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:03.005938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:03.006390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:03.006811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:03.039312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-37610602-ec37-441e-9ae4-4acf1f5bcc84 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056591 Oct 19 13:20:03.039885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 344/612] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:03.939258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:03.942046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:03.949473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:03.951002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:03.951484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:03.952198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:03.952646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:03.953089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:03.986005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ecf1926d-2f37-4afb-9f0e-8f5e389303ce tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050602 Oct 19 13:20:03.986577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 269/613] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:04.053790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:04.057241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:04.066431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:04.067333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:04.067788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:04.068631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:04.069148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:04.069558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:04.104891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7ce97304-a636-4d85-93c8-70305337036c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056655 Oct 19 13:20:04.105515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 345/614] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:04.999037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:05.001222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:05.008344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:05.008822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:05.009277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:05.009975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:05.010417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:05.010834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:05.042126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9772009a-9320-4ef6-b0e9-05f3b1e86c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047127 Oct 19 13:20:05.042701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 270/615] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:05.122224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:05.125773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:05.132776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:05.133301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:05.133731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:05.134413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:05.134856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:05.135282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:05.167118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dcd23dad-879a-4f22-8818-4818c2d96303 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051536 Oct 19 13:20:05.167940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 346/616] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:06.056779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:06.059903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:06.068976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:06.069455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:06.069870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:06.070555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:06.071000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:06.071416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:06.101290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2107ba69-813d-4d1a-96f7-dac213282968 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049910 Oct 19 13:20:06.101843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 271/617] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:06.184229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:06.187625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:06.201285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:06.202097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:06.202875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:06.204006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:06.204782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:06.205519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:06.237974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2a85c35d-6de4-4d81-bb88-c8ab4c75a352 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060232 Oct 19 13:20:06.238553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 347/618] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:07.116301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:07.118468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:07.125446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:07.125923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:07.126350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:07.127158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:07.127577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:07.127995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:07.157677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b6ceb30d-c2d3-455b-9167-688f1af3eecd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045480 Oct 19 13:20:07.158227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 272/619] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:07.253775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:07.255936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:07.262951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:07.263430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:07.263862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:07.264549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:07.265027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:07.265450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:07.297180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78ae47d4-364a-48a6-a296-d381696dd557 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049198 Oct 19 13:20:07.297787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 348/620] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:08.170757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:08.172933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:08.179910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:08.180387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:08.180823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:08.181542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:08.182028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:08.182426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:08.212977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2515bed6-7ec1-4124-99f2-81bfe55b8841 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046188 Oct 19 13:20:08.213535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 273/621] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:08.314117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:08.317845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:08.324743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:08.325267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:08.325702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:08.326415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:08.326866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:08.327291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:08.361426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9415896d-3761-40f9-9791-c08298442513 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053838 Oct 19 13:20:08.361989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 349/622] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:09.226696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:09.228967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:09.235504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:09.235986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:09.236410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:09.237132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:09.237566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:09.238014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:09.271784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-37beff75-bcd9-469e-88a3-41d30aa452d3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049709 Oct 19 13:20:09.272407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 274/623] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:09.378459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:09.382108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:09.393211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:09.394394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:09.395144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:09.395923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:09.396369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:09.396793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:09.427750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-22dce250-529e-4271-b889-3802ae2ac082 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055947 Oct 19 13:20:09.428339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 350/624] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:10.285116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:10.287864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:10.294415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:10.294894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:10.295350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:10.296041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:10.296538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:10.296977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:10.318336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:10.329581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-894457b4-9137-4586-b5ac-02426cf63079 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049249 Oct 19 13:20:10.330128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 275/625] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:10.444208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:10.446878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:10.455221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:10.455820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:10.456366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:10.457477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:10.458058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:10.458605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:10.494772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ef99b64-800a-4e89-9946-a78ba4085004 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056840 Oct 19 13:20:10.495364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 351/626] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:11.342347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:11.344540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:11.351711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:11.352188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:11.352615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:11.353445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:11.353781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:11.354177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:11.384891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-36dfd53a-67fe-456e-be2a-7e4af9889d24 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046423 Oct 19 13:20:11.385477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 276/627] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:11.511611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:11.514890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:11.523734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:11.524215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:11.524645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:11.525482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:11.525963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:11.526375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:11.557110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8a092798-4136-4f19-8235-87ad275f5287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052110 Oct 19 13:20:11.557505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 352/628] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:12.399466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:12.401966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:12.412345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:12.412931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:12.413479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:12.414385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:12.414833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:12.415248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:12.446529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12093b7c-c9bc-4e9f-8e6f-6f9c76f885d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051093 Oct 19 13:20:12.447083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 277/629] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:12.574419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:12.577797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:12.589878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:12.590733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:12.591489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:12.592906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:12.596126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:12.596849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:12.601406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:12.627037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b558b822-d0d2-4b62-b751-fd7a25f36cec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059973 Oct 19 13:20:12.627599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 353/630] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:13.463261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:13.466686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:13.476504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:13.477012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:13.477434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:13.478117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:13.478557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:13.478967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:13.509569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1b2620b4-7046-48e6-a69d-f322e9b95889 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053161 Oct 19 13:20:13.510154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 278/631] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:13.644496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:13.647892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:13.654732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:13.655213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:13.655905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:13.656322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:13.656762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:13.657214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:13.687959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d1d09c95-f358-4ed1-910c-6d5cf975be74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050596 Oct 19 13:20:13.688508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 354/632] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:14.523137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:14.525329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:14.532305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:14.532874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:14.533314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:14.534014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:14.534465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:14.534878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:14.564608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d6bc85da-b2f8-43a3-9e88-63f8bd89273c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046462 Oct 19 13:20:14.565210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 279/633] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:14.704069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:14.707211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:14.717893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:14.718639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:14.719309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:14.720367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:14.721094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:14.721774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:14.767012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e065d9c6-7250-4b5d-98fc-43b6c91117f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069333 Oct 19 13:20:14.767575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 355/634] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:15.581212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:15.584821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:15.596229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:15.597059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:15.600194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:15.600194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:15.600194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:15.600855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:15.632170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e06dff72-4ae4-4404-8641-dd2980ad362a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057748 Oct 19 13:20:15.632852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 280/635] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:15.840215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:15.842320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:15.848346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:15.848809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:15.849303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:15.849992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:15.850443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:15.850862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:15.879901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4a709e60-b3d7-4197-94df-b11ce6c4ce79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Oct 19 13:20:15.880451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 356/636] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:16.646408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:16.648466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:16.655156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:16.655662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:16.656093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:16.656778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:16.657259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:16.657662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:16.687964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1ea69a53-4b8c-45d7-9de6-97fe4879ee75 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046339 Oct 19 13:20:16.688510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 281/637] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:16.893905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:16.896136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:16.903203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:16.903662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:16.904086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:16.904825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:16.905313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:16.905785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:16.936040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-220a0d6d-8d91-43f7-a546-eca0d2cb33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046549 Oct 19 13:20:16.936604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 357/638] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:17.702309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:17.704729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:17.713457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:17.714023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:17.714511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:17.715296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:17.715841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:17.716336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:17.748777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a8e6e9f2-3f41-4701-be2f-83038a175fa7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051256 Oct 19 13:20:17.749367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 282/639] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:17.951285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:17.953508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:17.960016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:17.960499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:17.960963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:17.961652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:17.962105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:17.962693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:17.992766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e688c60c-1c3b-42d8-9426-9613504d95ef tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Oct 19 13:20:17.993363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 358/640] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:18.766247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:18.770143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:18.778873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:18.779377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:18.779795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:18.780484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:18.780962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:18.781373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:18.815356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1a80986c-9d58-4019-9bc7-5366de788e0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056130 Oct 19 13:20:18.815915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 283/641] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:19.009720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:19.013351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:19.023613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:19.024207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:19.024985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:19.025550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:19.025997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:19.026450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:19.056962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4f801373-d3c0-46c8-888e-a51a2748ab5f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052740 Oct 19 13:20:19.057533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 359/642] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:19.832430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:19.835935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:19.843598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:19.844081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:19.844555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:19.845274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:19.845742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:19.846171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:19.877456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d32498fc-fdba-4786-9de8-7aa4673a3601 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051762 Oct 19 13:20:19.878013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 284/643] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:20.073273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:20.075405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:20.081626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:20.082113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:20.082599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:20.083239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:20.083683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:20.084102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:20.113833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-806b8690-79b3-4375-97fa-84169ae30718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Oct 19 13:20:20.114372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 360/644] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:20.894799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:20.898113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:20.907903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:20.908633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:20.909285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:20.910333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:20.911012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:20.911641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:20.944998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ffb67e83-408b-4532-93fd-c7d5a9f49f29 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056788 Oct 19 13:20:20.945574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 285/645] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:21.127313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:21.129517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:21.136841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:21.137324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:21.137761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:21.138474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:21.138905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:21.139355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:21.170974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5b091f35-51f5-42c7-8728-d83fd60c4796 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048527 Oct 19 13:20:21.171540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 361/646] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:21.958190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:21.960306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:21.967559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:21.968032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:21.968453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:21.969179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:21.969618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:21.970029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:22.004797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-591b69f3-7766-4870-a325-195d538ad985 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050661 Oct 19 13:20:22.005555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 286/647] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:22.186071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:22.188277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:22.195067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:22.195554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:22.195989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:22.196695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:22.197185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:22.197631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:22.232168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b2970c9b-c6ab-4c97-a8b6-725c7d3ccc2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051026 Oct 19 13:20:22.232747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 362/648] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:23.021525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:23.032591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:23.043860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:23.044607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:23.045365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:23.046463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:23.047146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:23.047793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:23.081997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f6c27d66-28e2-424e-b34e-c9b8cb3108fc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066977 Oct 19 13:20:23.082592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 287/649] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:23.249449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:23.252944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:23.256555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:23.263616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:23.264100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:23.264525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:23.265237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:23.265694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:23.266108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:23.297618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8e471dda-766a-466b-999f-5227266b1bc1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054803 Oct 19 13:20:23.298201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 363/650] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:24.099186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:24.102696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:24.106602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:24.110601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:24.110813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:24.111239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:24.111927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:24.112362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:24.112770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:24.144241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a5bdb593-f650-49d3-a12d-1b8f3a47b505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051706 Oct 19 13:20:24.144829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 288/651] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:24.311861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:24.314770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:24.323492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:24.323848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:24.324276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:24.325011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:24.325627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:24.326060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:24.355964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5508a2bb-5982-4755-bded-de4474136916 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049121 Oct 19 13:20:24.356556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 364/652] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:25.160184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:25.163004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:25.172071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:25.172702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:25.173315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:25.174226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:25.174808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:25.175367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:25.208205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2c52a30b-e9ae-4dc0-a7dd-3ce4370bc435 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053458 Oct 19 13:20:25.208769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 289/653] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:25.368506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:25.370979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:25.377689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:25.378170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:25.378604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:25.379303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:25.379782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:25.380171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:25.412715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1b4a0862-8161-43c9-9b84-9e2fe8a74555 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Oct 19 13:20:25.413313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 365/654] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:26.226015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:26.229282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:26.236713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:26.237221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:26.237646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:26.238335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:26.238781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:26.239188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:26.270942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b10cd417-33a4-476b-bc42-083a2252931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051789 Oct 19 13:20:26.271496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 290/655] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:26.429674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:26.432941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:26.442573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:26.443361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:26.444023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:26.445108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:26.445795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:26.446435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:26.477712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-13cdd427-1148-46e9-8b28-8d7b41c0bd23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053973 Oct 19 13:20:26.478406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 366/656] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:27.283619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:27.285840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:27.293472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:27.293950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:27.294659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:27.295027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:27.295468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:27.295902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:27.327939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d9bf7c80-4e07-4be9-9c72-4abf5f84c9da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Oct 19 13:20:27.328510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 291/657] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:27.494727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:27.497549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:27.504087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:27.504787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:27.505450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:27.507800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:27.508274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:27.508680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:27.541438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4417f817-ee7a-470b-972b-7abdd9becfd5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053520 Oct 19 13:20:27.541999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 367/658] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:28.343217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:28.345419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:28.352258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:28.352730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:28.353239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:28.353964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:28.354409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:28.354823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:28.358725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:28.386009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7fdb2d0d-d164-47f8-9500-2fea7245af2b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047711 Oct 19 13:20:28.386602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 292/659] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:28.554768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:28.556967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:28.563868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:28.564351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:28.564781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:28.565570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:28.565965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:28.566389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:28.597767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59a3d8b8-1ed0-4b79-93f1-db374d56b395 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Oct 19 13:20:28.598334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 368/660] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:29.404077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:29.407533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:29.418304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:29.418777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:29.419695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:29.419880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:29.420304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:29.420709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:29.451818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f5cafe0c-8608-427a-bf37-eb082121bcf0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054857 Oct 19 13:20:29.452508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 293/661] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:29.614252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:29.618020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:29.626182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:29.626702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:29.627196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:29.627894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:29.628400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:29.628834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:29.655283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:29.660900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-348d8b5f-0bfb-4d05-9044-dbfe6e94f88c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052917 Oct 19 13:20:29.661440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 369/662] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:30.467108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:30.469310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:30.476367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:30.476771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:30.477915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:30.479229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:30.479229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:30.479510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:30.512777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c34aceec-f9fd-453f-bafd-34068ae7b4a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050737 Oct 19 13:20:30.517552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 294/663] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:30.674978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:30.677361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:30.684990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:30.685585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:30.686054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:30.686911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:30.687427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:30.687928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:30.720771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ce2db18-d349-4a38-b168-f456011f357e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Oct 19 13:20:30.721464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 370/664] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:31.528462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:31.531778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:31.541238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:31.541908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:31.542518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:31.543477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:31.544305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:31.544828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:31.576740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-575a5ee7-bda9-418e-86fc-37fc0195ad9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054122 Oct 19 13:20:31.577317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 295/665] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:31.734110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:31.736716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:31.743918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:31.744424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:31.744905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:31.745634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:31.746107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:31.746544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:31.778118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9c43cc21-1cfe-49d3-9e90-ffdec71e92bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048213 Oct 19 13:20:31.778735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 371/666] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:32.593953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:32.596203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:32.603283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:32.603778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:32.604232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:32.604964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:32.605446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:32.605932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:32.637954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e4ce792a-5f8b-46a2-af70-da0c224e80fe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049753 Oct 19 13:20:32.638785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 296/667] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:32.795048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:32.799023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:32.810094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:32.810584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:32.811008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:32.811709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:32.812157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:32.812574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:32.842115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c0532e4-bd00-4c65-9cf6-703e1f81dbd0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053815 Oct 19 13:20:32.842667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 372/668] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:33.657085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:33.660522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:33.671484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:33.672510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:33.672510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:33.673171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:33.673646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:33.674039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:33.706607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d620cbd4-674c-4b76-9000-dd542991f1ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057272 Oct 19 13:20:33.707176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 297/669] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:33.858025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:33.860309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:33.867187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:33.867673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:33.868106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:33.868807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:33.869294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:33.869716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:33.900698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6433aa18-fda7-4934-9296-78fb39c76de3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049012 Oct 19 13:20:33.901284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 373/670] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:34.723934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:34.727362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:34.736215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:34.736696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:34.737146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:34.737816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:34.738252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:34.738669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:34.770604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2f108d4f-65fe-4f05-b19c-284e794dc615 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053530 Oct 19 13:20:34.771427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 298/671] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:34.916748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:34.921910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:34.933482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:34.934289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:34.935009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:34.935943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:34.936509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:34.936982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:34.966741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-850f553f-1b88-4a99-8b8c-4c2015532616 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056312 Oct 19 13:20:34.967262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 374/672] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:35.785887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:35.788540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:35.797197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:35.797792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:35.798417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:35.799282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:35.799845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:35.800370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:35.836127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2774bba6-a1e3-415f-ada3-2dca6eb931d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055269 Oct 19 13:20:35.836683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 299/673] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:20:35.983957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:35.986102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:35.993081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:35.993572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:35.994012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:35.994704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:35.995150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:35.995583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:36.025785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-25e0cdc3-88da-4461-b4ba-90fda9bb9e1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Oct 19 13:20:36.026352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 375/674] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:36.853565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:36.856855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:36.864106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:36.864816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:36.865034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:36.865717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:36.866168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:36.866577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:36.897993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3722afed-44dd-4dce-9da8-eed7c9fc8d74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051208 Oct 19 13:20:36.898561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 300/675] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:37.038713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:37.040972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:37.048118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:37.048707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:37.049213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:37.049980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:37.050457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:37.050903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:37.081200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3402e3ad-3b46-43cd-b0a8-f1578206888e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Oct 19 13:20:37.081763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 376/676] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:37.911938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:37.914119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:37.921805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:37.922281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:37.922710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:37.923417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:37.923861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:37.924278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:37.955616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-89b9181a-3567-4fc1-bba4-c42bb461b58d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047697 Oct 19 13:20:37.956161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 301/677] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:38.096076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:38.098333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:38.105541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:38.106030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:38.106448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:38.107146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:38.107598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:38.108265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:38.138164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dbebb7cc-6cce-47d9-a270-7dd3826125de tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Oct 19 13:20:38.138900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 377/678] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:38.973371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:38.976829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:38.986247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:38.986726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:38.987151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:38.987840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:38.988286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:38.988708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:39.021161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b7aa2a2-d0bb-4b19-8a45-a5163052d485 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054660 Oct 19 13:20:39.021948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 302/679] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:39.156396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:39.160449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:39.171677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:39.172179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:39.172611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:39.173355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:39.173834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:39.174255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:39.204384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bf1dbc4b-0d52-458f-8d74-3f222908127a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055123 Oct 19 13:20:39.205138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 378/680] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:40.038315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:40.041578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:40.052442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:40.053208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:40.053924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:40.054979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:40.056040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:40.056328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:40.088660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad04dc99-99c9-4e61-a404-4d3fccdfc0f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057096 Oct 19 13:20:40.089271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 303/681] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:40.219860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:40.222087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:40.229859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:40.230348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:40.230773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:40.231472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:40.231931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:40.232365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:40.261815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a457fce1-6f1b-4a1f-87af-52053e215913 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047448 Oct 19 13:20:40.262374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 379/682] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:41.105911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:41.108960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:41.115961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:41.116440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:41.116902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:41.118061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:41.118061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:41.118422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:41.149925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6d9d61f5-def9-4062-89a8-ad87e83c6c6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050799 Oct 19 13:20:41.150695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 304/683] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:41.279428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:41.283707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:41.296725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:41.297256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:41.297680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:41.298377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:41.298819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:41.299231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:41.331732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52d9a29b-2750-4501-b549-aa7713a75914 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059230 Oct 19 13:20:41.332304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 380/684] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:42.167433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:42.170842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:42.177740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:42.178213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:42.178634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:42.179305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:42.179735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:42.180152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:42.212065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0dd3d0b7-185a-4580-8ebd-6bdb782ebaf5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051556 Oct 19 13:20:42.212628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 305/685] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:42.344017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:42.346526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:42.353322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:42.353809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:42.354248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:42.354947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:42.355402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:42.355829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:42.386200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a77b09c1-a1f1-4d65-ab4f-27bcdb9e5be0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Oct 19 13:20:42.386941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 381/686] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:43.229251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:43.232997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:43.243928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:43.244718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:43.245481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:43.246580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:43.247359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:43.248053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:43.279825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e677f637-ade9-4f38-a2f0-3dd86220f9ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057246 Oct 19 13:20:43.280397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 306/687] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:43.403741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:43.407306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:43.418042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:43.418871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:43.419597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:43.420706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:43.421188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:43.421613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:43.452400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4ec51fdc-c520-456c-9b6e-4f50b44f1fa3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055474 Oct 19 13:20:43.453064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 382/688] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:44.296581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:44.298743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:44.305802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:44.306542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:44.306650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:44.307367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:44.307810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:44.308226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:44.340300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b7681a5-9162-4ae5-a37e-89f2ff6c762a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050115 Oct 19 13:20:44.340902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 307/689] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:44.469264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:44.472681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:44.482979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:44.483486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:44.483910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:44.484583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:44.485084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:44.485502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:44.514897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4f066ab7-541b-4940-aacb-ca02bb17936a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052058 Oct 19 13:20:44.515418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 383/690] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:45.353231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:45.355388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:45.362256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:45.362733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:45.363152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:45.363839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:45.364279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:45.364690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:45.391939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:45.398043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee6e60da-42ab-4ffe-a076-9547add1d1ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048873 Oct 19 13:20:45.398831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 308/691] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:45.530054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:45.531876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:45.538601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:45.539080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:45.539510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:45.540196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:45.540639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:45.541094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:45.572089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b60a220-c817-4eec-b453-c9b31d53a67d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Oct 19 13:20:45.572574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 384/692] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:46.415779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:46.419264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:46.427416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:46.427900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:46.428825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:46.429167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:46.429512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:46.429930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:46.464295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0369a945-b38c-4e03-9277-1842597d4c1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055416 Oct 19 13:20:46.464868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 309/693] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:46.589601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:46.593312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:46.604950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:46.605756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:46.606479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:46.607620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:46.608383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:46.609358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:46.641125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f8e5f49-2427-401a-91be-38ffb24b75e1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058571 Oct 19 13:20:46.641682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 385/694] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:47.481926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:47.485436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:47.495996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:47.496780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:47.497960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:47.501847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:47.502641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:47.503655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:47.534866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7d0ee641-4497-4038-97a1-e1875781377f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059984 Oct 19 13:20:47.535401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 310/695] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:47.658493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:47.660670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:47.667388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:47.667879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:47.668313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:47.669070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:47.669522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:47.669943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:47.689274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:47.702255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce558053-929f-4914-af29-f5420bf585fa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 Oct 19 13:20:47.702823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 386/696] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:48.549240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:48.551506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:48.558518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:48.559005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:48.559434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:48.560128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:48.560574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:48.561019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:48.593084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b90e210a-c265-4e8a-9ce5-7739851cdd30 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048576 Oct 19 13:20:48.593655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 311/697] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:48.714870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:48.717092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:48.724583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:48.725095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:48.725525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:48.726219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:48.726679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:48.727086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:48.757001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8eacfc42-849e-4c63-b89f-e1eae6d2269d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Oct 19 13:20:48.757559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 387/698] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:49.609657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:49.612107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:49.619309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:49.619788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:49.620561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:49.620895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:49.621374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:49.621788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:49.655569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-625af040-89b7-426c-9533-e6801c6649ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052259 Oct 19 13:20:49.656120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 312/699] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:49.775170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:49.779795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:49.788308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:49.788911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:49.789359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:49.790045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:49.790494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:49.790904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:49.820409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75f4a66e-2679-4405-836a-ddf39afc4d31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051795 Oct 19 13:20:49.820959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 388/700] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:50.675499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:50.678823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:50.691153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:50.691153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:50.691153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:50.691862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:50.692428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:50.693018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:50.723979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-51df90ee-c225-4ea4-a076-92f72bc99977 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056117 Oct 19 13:20:50.724543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 313/701] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:50.837378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:50.840787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:50.852513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:50.853333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:50.854128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:50.855216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:50.855961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:50.856648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:50.887846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e5de1f38-8a50-4716-8a54-5a27d6916c8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057234 Oct 19 13:20:50.888407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 389/702] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:51.739807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:51.742086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:51.749681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:51.750453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:51.750621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:51.751406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:51.751950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:51.752409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:51.785371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fae121b2-6031-4950-865b-c6ec39303398 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050950 Oct 19 13:20:51.785942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 314/703] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:51.905687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:51.908974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:51.915856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:51.916405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:51.916910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:51.917661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:51.918146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:51.918574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:51.949120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3bcea1c3-b841-40e6-8efa-da35b1fb3e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050532 Oct 19 13:20:51.949806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 390/704] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:52.802318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:52.805785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:52.816278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:52.816762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:52.817208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:52.817890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:52.818402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:52.818710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:52.850290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0b09d17a-e7ce-4d65-a6d7-828fd57db8f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054879 Oct 19 13:20:52.850874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 315/705] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:52.962742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:52.964882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:52.972088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:52.972738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:52.973208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:52.973920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:52.974376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:52.974785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:53.005156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4cb2b3c0-1795-4a69-bc6d-8511ee20ad07 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Oct 19 13:20:53.005727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 391/706] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:53.866359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:53.868515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:53.875169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:53.875651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:53.876078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:53.876989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:53.877228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:53.877643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:53.910604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-73208926-10c5-4daf-8b86-195816365a19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049177 Oct 19 13:20:53.911155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 316/707] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:54.021217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:54.023380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:54.025717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:54.031289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:54.031782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:54.032220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:54.032900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:54.033369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:54.033787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:54.064170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f814f4c6-6999-4f55-8bfa-f4520ad20c03 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048864 Oct 19 13:20:54.064737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 392/708] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:54.928033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:54.931555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:54.935205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:20:54.943001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:54.943244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:54.943663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:54.944348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:54.944782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:54.945298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:54.976442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f359a3e0-6d9f-4115-9dca-818df7121758 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055177 Oct 19 13:20:54.977040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 317/709] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:55.079321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:55.082217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:55.090757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:55.091345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:55.091882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:55.092778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:55.093374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:55.093896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:55.123815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c9ede5a-b77f-4b58-9995-03cab9940afc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Oct 19 13:20:55.124543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 393/710] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:55.993977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:55.997591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:56.006520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:56.007019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:56.007437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:56.008122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:56.008673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:56.008990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:56.039040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb29ef72-c08b-4c41-8e49-7548fa7071c0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052122 Oct 19 13:20:56.039611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 318/711] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:56.137667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:56.139952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:56.147387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:56.147887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:56.148346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:56.149093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:56.149545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:56.150010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:56.180645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af2500fc-52b1-4306-a06a-71463b3524ab tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Oct 19 13:20:56.181269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 394/712] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:57.055375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:57.058020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:57.067041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:57.067629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:57.068167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:57.069065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:57.069620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:57.070151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:57.103526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-207ee627-a158-41c4-9328-793891636849 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054176 Oct 19 13:20:57.104073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 319/713] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:57.194178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:57.196704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:57.203313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:57.203808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:57.204242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:57.204975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:57.205454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:57.205877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:57.235931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-16934de8-3963-40dc-af55-223f378dbb1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046392 Oct 19 13:20:57.236666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 395/714] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:58.120828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:58.124282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:58.132560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:58.133068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:58.133489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:58.134172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:58.134609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:58.135022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:58.165258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a37045cd-3295-4aab-81d5-9a9b7023ec70 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051366 Oct 19 13:20:58.165716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 320/715] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:58.249647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:58.252042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:58.259755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:58.260287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:58.260773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:58.261584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:58.262081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:58.262544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:58.299615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7c2fadb9-3e4c-4bf7-90d2-470340b45951 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054425 Oct 19 13:20:58.300402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 396/716] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:20:59.185020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:59.188529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:59.199690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:59.200467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:59.201283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:59.202411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:59.203140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:59.203822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:59.235490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5abae282-8323-4613-8129-b175170bf8d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057095 Oct 19 13:20:59.236036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 321/717] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:20:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:20:59.311697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:20:59.313956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:20:59.320890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:59.321402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:59.321833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:59.322532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:20:59.323002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:20:59.323422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:20:59.359043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c7e5731e-3823-44ce-a2bb-291d9f80115e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051237 Oct 19 13:20:59.359704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 397/718] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:20:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:00.253598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:00.255677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:00.262502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:00.262981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:00.263406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:00.264093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:00.264536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:00.264989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:00.303219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9164315-6265-4cea-9984-32bf406a8947 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056770 Oct 19 13:21:00.303806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 322/719] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:00.375393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:00.378746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:00.385689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:00.386175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:00.386610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:00.387309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:00.387759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:00.388182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:00.418976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0ccf8958-e0cf-4deb-abe2-21da3cf578d1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049796 Oct 19 13:21:00.419758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 398/720] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:01.318273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:01.321280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:01.328172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:01.328690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:01.329181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:01.329877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:01.330321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:01.330736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:01.361787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07b89ddc-3349-48df-96a7-ef231f898a89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047465 Oct 19 13:21:01.362245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 323/721] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:01.569775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:01.571980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:01.578050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:01.578529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:01.578961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:01.579637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:01.580091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:01.580514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:01.610971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-757cde0f-fc43-405a-be8c-dbaf9e1b7bc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181408 Oct 19 13:21:01.611519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 399/722] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:02.381214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:02.383732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:02.391682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:02.392597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:02.393153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:02.393949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:02.394568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:02.395295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:02.427409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-30833687-e5ef-4cd7-8e7f-52476d7bc38f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052883 Oct 19 13:21:02.428055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 324/723] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:02.626732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:02.629308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:02.636224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:02.636708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:02.637170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:02.637870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:02.638315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:02.638735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:02.668487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d7989ee-364b-4bba-bcd7-95f90225632b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Oct 19 13:21:02.669076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 400/724] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:03.443537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:03.445798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:03.452830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:03.453382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:03.453824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:03.454560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:03.455023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:03.455456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:03.474466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:03.487268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5778651e-b7c2-410a-962d-2a933af99493 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049511 Oct 19 13:21:03.487820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 325/725] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:03.681851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:03.684831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:03.695921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:03.696662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:03.697201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:03.698020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:03.698479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:03.698906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:03.741792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e94c58dc-87bd-4cac-90e2-a3f2e5a2bef5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063715 Oct 19 13:21:03.742759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 401/726] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:04.499823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:04.502024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:04.508736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:04.509240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:04.509664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:04.510344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:04.510784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:04.511194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:04.542065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aa18ba98-e1b4-4b98-99ca-2ce7a2ebccd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046331 Oct 19 13:21:04.542613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 326/727] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:04.757273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:04.759503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:04.766261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:04.766752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:04.767543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:04.768238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:04.768692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:04.769132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:04.801062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c17bd70-d419-4237-ac33-f4cb2859de79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047727 Oct 19 13:21:04.801662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 402/728] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:05.559402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:05.562907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:05.571241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:05.571653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:05.572089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:05.572781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:05.573262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:05.573685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:05.603641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8982c683-833d-47ca-b6e1-aadbeb9685ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051125 Oct 19 13:21:05.604192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 327/729] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:05.813715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:05.815915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:05.822757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:05.823182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:05.823584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:05.824306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:05.824755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:05.825237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:05.829986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:05.855127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1cec4db-3782-427c-96ac-839acf590e50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Oct 19 13:21:05.855653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 403/730] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:06.618529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:06.620776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:06.627570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:06.628045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:06.628467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:06.629389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:06.629866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:06.630262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:06.661421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-19039a13-3e68-4352-8356-891a26ce42db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047413 Oct 19 13:21:06.661986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 328/731] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:06.867696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:06.869908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:06.876554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:06.877114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:06.877548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:06.878211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:06.878745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:06.879283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:06.910315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4cf5c067-f679-47da-8724-0a0bc669f897 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Oct 19 13:21:06.910887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 404/732] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:07.680328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:07.683729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:07.693672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:07.694160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:07.694593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:07.695290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:07.695740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:07.696164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:07.726809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ebd1422d-b076-4ebf-9c95-6466473c7658 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055037 Oct 19 13:21:07.727354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 329/733] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:07.923193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:07.925645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:07.934136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:07.934717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:07.935171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:07.935904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:07.936389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:07.936894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:07.967234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c9db7812-0b5b-4ead-bbbb-752af8f5c9bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Oct 19 13:21:07.967782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 405/734] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:08.742538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:08.744840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:08.752420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:08.752975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:08.753447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:08.754369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:08.754863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:08.755319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:08.786763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cc1f00e7-407b-49a8-a847-f5ebd8f97628 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049222 Oct 19 13:21:08.787312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 330/735] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:08.979697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:08.981939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:08.988713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:08.989243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:08.989680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:08.990384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:09.003832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:09.003832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:09.022271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-164d593e-f5c7-4b7c-9d71-11f235d3dfdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046511 Oct 19 13:21:09.023047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 406/736] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:09.802986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:09.806015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:09.813268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:09.813743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:09.814169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:09.814864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:09.815307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:09.815726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:09.846514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3928ab50-a455-4e22-8906-d4b04b8e32eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049714 Oct 19 13:21:09.847068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 331/737] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:10.038116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:10.040881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:10.047824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:10.048309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:10.048733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:10.049482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:10.049916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:10.050332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:10.080326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0077ca43-ebe1-4491-b0db-dfa5a48476db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Oct 19 13:21:10.080888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 407/738] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:10.863704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:10.866241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:10.873131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:10.873616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:10.874048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:10.874737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:10.875194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:10.875613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:10.905916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-67cda4b4-1ad8-4367-a5b2-bbc2dbfe573a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048975 Oct 19 13:21:10.906461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 332/739] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:11.096582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:11.099961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:11.106779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:11.107260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:11.107688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:11.108389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:11.108826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:11.109276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:11.141294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1bba890c-770a-4af8-8fc7-c1cfc638ee3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051207 Oct 19 13:21:11.143880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 408/740] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:11.923416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:11.926940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:11.938972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:11.939746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:11.940498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:11.941657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:11.942441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:11.943124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:11.975168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-84086058-9097-4eb9-ac00-5c2a6c510f15 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058569 Oct 19 13:21:11.975811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 333/741] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:12.160017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:12.163840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:12.174934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:12.175638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:12.176353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:12.177559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:12.178319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:12.179392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:12.214761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1a437a79-7eea-4267-bb6f-bc70fc752f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061627 Oct 19 13:21:12.215533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 409/742] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:12.989932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:12.992338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:12.999148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:12.999634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:13.000067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:13.000739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:13.001215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:13.001632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:13.031905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-22f39a91-34e3-4dfc-8881-4eccb4777803 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046789 Oct 19 13:21:13.032470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 334/743] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:13.230471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:13.232915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:13.240773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:13.241645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:13.242157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:13.242972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:13.243498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:13.243987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:13.277549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae59cc9c-8929-4c3a-8cb4-ec988076d908 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052529 Oct 19 13:21:13.278292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 410/744] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:14.049496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:14.052933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:14.063946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:14.064726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:14.065694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:14.066824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:14.067571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:14.068268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:14.098803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb835741-8aac-45d1-97f3-97394b0b1ce4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056435 Oct 19 13:21:14.099352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 335/745] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:14.292704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:14.295049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:14.302222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:14.302732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:14.303183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:14.303979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:14.304469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:14.305023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:14.336423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01361dc5-6c28-4266-a03c-595f78dde66f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048758 Oct 19 13:21:14.337144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 411/746] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:15.115108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:15.117817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:15.125059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:15.125566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:15.125996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:15.126690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:15.127141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:15.127562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:15.164245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f27a8a2f-1df2-491b-a94c-3dd9c80755d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053997 Oct 19 13:21:15.164957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 336/747] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:15.349564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:15.351726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:15.358685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:15.359173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:15.359730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:15.360432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:15.360895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:15.361334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:15.391628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba023d42-014e-4b36-a5c4-ed7163f7399b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Oct 19 13:21:15.392735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 412/748] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:16.182293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:16.185677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:16.195778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:16.196272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:16.196701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:16.197429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:16.197872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:16.198312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:16.228761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f9d05572-4be6-47f4-8bf2-9891159562ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053627 Oct 19 13:21:16.229345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 337/749] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:16.409266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:16.412704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:16.419891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:16.420378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:16.420811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:16.421545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:16.422122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:16.422551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:16.452842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1c778b2-71e2-4fd6-9b4b-6d5f5c25a1e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 Oct 19 13:21:16.453458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 413/750] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:17.246727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:17.250061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:17.259179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:17.259650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:17.260073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:17.260753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:17.261228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:17.261635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:17.291964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d344b6d4-9d23-44a9-981b-ce3f725f2381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052509 Oct 19 13:21:17.292535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 338/751] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:17.472091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:17.475772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:17.486741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:17.487540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:17.488257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:17.489493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:17.490244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:17.491093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:17.521885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9d5deb19-5897-403a-ba47-64cce8c6269a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056643 Oct 19 13:21:17.524101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 414/752] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:18.306539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:18.308664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:18.315537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:18.316293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:18.316398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:18.317126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:18.317561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:18.318002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:18.347523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6593bcc0-1e8c-41d0-b86f-bdf17f798de9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046133 Oct 19 13:21:18.348064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 339/753] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:18.538871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:18.541025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:18.547874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:18.548349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:18.548781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:18.549493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:18.549942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:18.550428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:18.581333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0eb2b638-9de8-4899-b4fc-ed49097ff7af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049106 Oct 19 13:21:18.581920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 415/754] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:19.365113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:19.367929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:19.377459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:19.378088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:19.378648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:19.379560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:19.380144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:19.380682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:19.413119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b60249e8-be0d-4332-a965-d9c371882b5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053415 Oct 19 13:21:19.413657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 340/755] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:19.598370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:19.601511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:19.611660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:19.612463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:19.613189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:19.614211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:19.614964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:19.615611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:19.647463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3738e297-3ba4-45e5-9a62-41beb6d89633 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055678 Oct 19 13:21:19.648012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 416/756] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:20.430540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:20.432893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:20.440313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:20.440820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:20.441307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:20.442034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:20.442504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:20.442948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:20.474870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-06a45896-af82-4853-b310-2ef1f7183dff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051106 Oct 19 13:21:20.475432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 341/757] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:20.663679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:20.666605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:20.673855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:20.674338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:20.674769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:20.675456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:20.675913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:20.676335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:20.707177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f55ce07-297c-4349-8a37-211481da7324 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049136 Oct 19 13:21:20.708031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 417/758] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:21.487302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:21.489458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:21.496755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:21.497258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:21.497683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:21.498375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:21.498818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:21.499227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:21.503285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:21.541104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9f8d2490-2cb0-4022-b4f0-8071d029ab7f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057744 Oct 19 13:21:21.541679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 342/759] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:21.720630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:21.724077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:21.732394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:21.733093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:21.733532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:21.734246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:21.734702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:21.735121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:21.770187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5572924f-3b3b-4628-a89d-55e61c4e28a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053983 Oct 19 13:21:21.770802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 418/760] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:22.558759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:22.562248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:22.573521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:22.574178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:22.574884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:22.576187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:22.576755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:22.577499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:22.613455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-71cc09a5-0205-4f69-af94-ff44df8dcfeb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061851 Oct 19 13:21:22.614008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 343/761] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:22.785162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:22.787393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:22.795622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:22.796102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:22.796531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:22.797251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:22.797707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:22.798116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:22.825086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:22.831066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-84c38284-0483-4d72-a1a2-9bac5bd4d846 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051436 Oct 19 13:21:22.831750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 419/762] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:23.630293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:23.632945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:23.640504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:23.640936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:23.641422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:23.642481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:23.642931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:23.643344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:23.674457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1ccde79e-39f7-4921-ae57-4b032230b91c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049761 Oct 19 13:21:23.675013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 344/763] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:23.848730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:23.852442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:23.860380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:23.860883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:23.861312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:23.862008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:23.862453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:23.862872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:23.893646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-593c33b3-22a8-4d30-9511-583852786aee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052015 Oct 19 13:21:23.894109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 420/764] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:24.688752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:24.690896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:24.699266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:24.699777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:24.700239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:24.700968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:24.701415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:24.701882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:24.736354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-19df695e-bae3-467c-a760-6f877e3717d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051878 Oct 19 13:21:24.737011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 345/765] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:24.908177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:24.910331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:24.912674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:24.919939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:24.920419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:24.920853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:24.922467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:24.922946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:24.923372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:24.958221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c2498d16-de1e-4570-a493-bccefb27bf3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054690 Oct 19 13:21:24.958691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 421/766] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:25.749974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:25.752076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:25.754478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:25.760123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:25.761051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:25.761716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:25.762423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:25.762872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:25.763343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:25.803381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0e05e80d-0ff5-4647-87d9-98ef68ad8613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057436 Oct 19 13:21:25.803943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 346/767] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:25.973550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:25.975745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:25.984202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:25.984730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:25.985215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:25.985927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:25.986389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:25.986809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:26.024502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-42212e44-70a4-4c3e-b4ce-1c31bb24e47a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054590 Oct 19 13:21:26.026119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 422/768] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:26.821054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:26.824163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:26.831465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:26.831946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:26.832376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:26.833121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:26.833572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:26.833993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:26.865743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12edecd6-371d-497c-81de-024d386d0ab7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051804 Oct 19 13:21:26.866287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 347/769] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:27.039136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:27.041323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:27.048189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:27.048681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:27.049180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:27.049877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:27.050329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:27.050755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:27.081855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce453d41-0cce-4378-a977-a97318b686ee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Oct 19 13:21:27.082333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 423/770] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:27.886722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:27.890219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:27.901638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:27.902534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:27.903024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:27.903730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:27.904205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:27.904670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:27.935946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-95ddc880-f22a-47c3-95c4-a53a22cce854 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055915 Oct 19 13:21:27.936512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 348/771] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:28.098926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:28.102480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:28.110431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:28.110919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:28.111362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:28.112049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:28.112501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:28.113051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:28.144741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8517afb4-7a2e-4176-bb2c-710878877eee tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052620 Oct 19 13:21:28.145257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 424/772] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:28.948794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:28.951087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:28.957910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:28.958799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:28.958799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:28.959508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:28.959957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:28.960376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:28.990613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49f89f7c-cb0f-4111-87ee-0919bc6ad044 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Oct 19 13:21:28.991148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 349/773] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:29.161331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:29.164138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:29.172124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:29.172615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:29.173103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:29.173801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:29.174310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:29.174744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:29.206260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d1101903-b50e-4c66-b213-5af5b15d9911 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051465 Oct 19 13:21:29.206852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 425/774] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:30.003695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:30.005838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:30.013596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:30.014087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:30.014520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:30.015221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:30.015661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:30.016080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:30.047955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cbc24241-89ef-478e-8983-bac48f002be4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048374 Oct 19 13:21:30.048523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 350/775] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:30.219687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:30.221903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:30.229199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:30.229679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:30.230192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:30.230891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:30.231335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:30.231753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:30.262011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b2917e01-43d2-44f9-928d-14d9a83ce479 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046123 Oct 19 13:21:30.262485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 426/776] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:31.060386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:31.062703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:31.069722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:31.070206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:31.070640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:31.071302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:31.071928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:31.072180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:31.104053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ac75817f-dfa5-4e53-9c67-7615fdbab126 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047748 Oct 19 13:21:31.104612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 351/777] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:31.278079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:31.281926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:31.290151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:31.290636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:31.291043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:31.291760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:31.292531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:31.293274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:31.325167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-740a270b-7e9e-4168-8dc1-89e50e060523 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053176 Oct 19 13:21:31.325760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 427/778] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:32.119224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:32.121453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:32.128669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:32.129183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:32.129847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:32.130983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:32.131921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:32.132615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:32.165938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6950f9fd-caaf-4f45-8501-c84a4e8a6f54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050783 Oct 19 13:21:32.166511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 352/779] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:32.338987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:32.341310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:32.348278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:32.348763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:32.349231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:32.349931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:32.350388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:32.350811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:32.382814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-67e550f3-6f6b-45f2-9998-8ef986a37bd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Oct 19 13:21:32.383363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 428/780] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:33.184884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:33.187112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:33.194258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:33.194742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:33.195172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:33.195868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:33.196317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:33.196737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:33.226941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-46e49770-0a9b-4c5b-b070-1fc5125aa965 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048878 Oct 19 13:21:33.227491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 353/781] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:33.400383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:33.403885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:33.414777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:33.415566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:33.416286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:33.417488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:33.418213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:33.418838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:33.448377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed8af041-9d34-4030-8c8e-32dac34cf09e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054453 Oct 19 13:21:33.448883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 429/782] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:34.244669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:34.248170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:34.259252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:34.260032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:34.260732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:34.261914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:34.262732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:34.263171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:34.294346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-17b790a6-16cc-47d7-89ce-a2753aa0b25b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056323 Oct 19 13:21:34.294893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 354/783] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:34.465843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:34.468283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:34.475306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:34.476087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:34.476525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:34.477228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:34.477874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:34.478573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:34.509815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d73ce062-e0f4-48ca-ba48-a84afe422fdb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050919 Oct 19 13:21:34.511108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 430/784] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:35.310666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:35.312820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:35.319669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:35.320147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:35.320603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:35.321328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:35.321773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:35.322188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:35.353306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9de1ef42-f5a1-473e-877d-07b725f8648e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049043 Oct 19 13:21:35.353857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 355/785] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:35.525174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:35.527817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:35.536190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:35.536791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:35.537385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:35.538235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:35.538798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:35.539322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:35.569301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0aeeb173-2413-406e-80ae-b3ef35bed149 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049074 Oct 19 13:21:35.569763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 431/786] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:36.370785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:36.374672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:36.385802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:36.386561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:36.387263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:36.388432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:36.388991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:36.389413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:36.420818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c58a18c-5261-460a-b211-3822e460148c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056811 Oct 19 13:21:36.421408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 356/787] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:36.582919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:36.585001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:36.593196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:36.593732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:36.594196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:36.594899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:36.595351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:36.595773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:36.631596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7760f862-1c91-4d1d-9473-ba9b4791117b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052771 Oct 19 13:21:36.632182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 432/788] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:37.437513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:37.439632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:37.453724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:37.453724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:37.453724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:37.453724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:37.454219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:37.454219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:37.481237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5792084c-8141-4d18-9fb8-f42c5fddab7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049655 Oct 19 13:21:37.481824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 357/789] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:37.645158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:37.647254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:37.654279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:37.654772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:37.655698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:37.656405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:37.656883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:37.657312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:37.688460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-37c075cf-8580-4604-b846-e553e79a8d2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Oct 19 13:21:37.689050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 433/790] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:38.494697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:38.496948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:38.504142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:38.504626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:38.505083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:38.505850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:38.506289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:38.506703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:38.536553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:38.542499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-16eb4013-e5b8-43c8-a07c-ef58cc6a6e6b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051931 Oct 19 13:21:38.543118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 358/791] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:38.702034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:38.704096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:38.711102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:38.711594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:38.712044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:38.712737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:38.713231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:38.713656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:38.745937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c6203631-c459-4855-b802-59b929789160 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Oct 19 13:21:38.746554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 434/792] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:39.560619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:39.564191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:39.574912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:39.575692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:39.576413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:39.577131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:39.577571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:39.577986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:39.608645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-38d7dbd7-fe75-461f-b417-b75920af3308 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055101 Oct 19 13:21:39.609284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 359/793] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:39.759114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:39.762194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:39.771159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:39.771645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:39.772073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:39.772773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:39.773282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:39.773699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:39.804727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3092de83-8b09-438d-927e-c14bd07bc6bf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049590 Oct 19 13:21:39.805379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 435/794] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:40.621922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:40.624808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:40.631795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:40.632277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:40.632708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:40.633481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:40.633939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:40.634357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:40.667132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-17b5f9b9-b733-46ef-bab7-cef16ef40868 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049257 Oct 19 13:21:40.667703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 360/795] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:40.817801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:40.819971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:40.827287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:40.827705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:40.828134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:40.828887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:40.829373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:40.829799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:40.848206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:40.861601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3022dc45-715e-4900-83e8-f14198a9b10e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047848 Oct 19 13:21:40.862181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 436/796] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:41.685336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:41.687729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:41.695021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:41.695503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:41.695932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:41.696632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:41.697097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:41.697516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:41.731002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9e49bcb-833e-4f0f-87ad-334b70fe16e3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053782 Oct 19 13:21:41.731572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 361/797] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:41.875649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:41.878012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:41.885122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:41.885622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:41.886062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:41.886778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:41.887235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:41.887667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:41.919029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-38295dd9-96fc-4a43-b517-64b5ea5f4d1e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048652 Oct 19 13:21:41.919603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 437/798] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:42.744353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:42.746557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:42.753700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:42.754179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:42.754606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:42.755296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:42.755710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:42.756123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:42.788229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-69aebd78-2acd-4b02-a1c0-9bc408c0b8ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047837 Oct 19 13:21:42.788774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 362/799] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:42.938407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:42.940597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:42.947220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:42.947700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:42.948136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:42.948839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:42.949319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:42.949740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:42.981099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aa383e09-273b-4956-b12b-cb33a9457be3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Oct 19 13:21:42.981671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 438/800] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:43.801295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:43.803458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:43.810422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:43.810900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:43.811322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:43.812496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:43.812635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:43.813024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:43.845143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-edcb35eb-3de1-449a-87f2-9b1d6d1c88c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047796 Oct 19 13:21:43.845742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 363/801] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:43.994886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:43.997065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:44.006000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:44.006489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:44.007991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:44.007991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:44.008214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:44.008482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:44.042061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c1698a8a-c61a-4dc4-a53b-de7bcc77f209 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051185 Oct 19 13:21:44.042654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 439/802] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:44.858365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:44.860727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:44.867679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:44.868167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:44.868589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:44.869331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:44.869780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:44.870203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:44.902344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-164897e8-ff28-4eb1-9a52-bd6898b3409a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048033 Oct 19 13:21:44.902987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 364/803] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:45.055744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:45.057950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:45.065441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:45.065931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:45.066367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:45.067067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:45.067523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:45.067949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:45.098177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7c19a161-3615-415a-bcbe-80537b552701 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 Oct 19 13:21:45.098744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 440/804] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:45.920392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:45.924240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:45.935276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:45.936300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:45.937457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:45.938042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:45.938517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:45.938964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:45.968692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-83ffa605-bc33-48ed-9ac3-d81508779fb8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055378 Oct 19 13:21:45.969262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 365/805] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:21:46.115564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:46.119102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:46.130471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:46.131209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:46.131946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:46.133144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:46.133965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:46.134692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:46.167393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-81713b3e-792b-4b1e-ba79-b4248b5b2309 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058888 Oct 19 13:21:46.168154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 441/806] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:46.984418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:46.986512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:46.993090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:46.993562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:46.993983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:46.994663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:46.995099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:46.995531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:47.027019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-465258b6-4606-444a-9423-a1d196980c16 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048920 Oct 19 13:21:47.027566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 366/807] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:47.181905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:47.184093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:47.191192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:47.191666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:47.192099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:47.192797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:47.193269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:47.193686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:47.225565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-17fcefd1-adb1-47c3-a522-4ad99e6b64d3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048430 Oct 19 13:21:47.226149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 442/808] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:48.040985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:48.043170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:48.050760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:48.051241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:48.051668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:48.052363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:48.052811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:48.053263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:48.084786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-48d9640f-e023-469a-8932-a85a65e1024a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047830 Oct 19 13:21:48.085393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 367/809] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:48.240592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:48.242708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:48.249500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:48.250069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:48.250524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:48.251212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:48.251662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:48.252077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:48.282760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a59c311a-9207-4565-a568-27c4d8b6e60a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046208 Oct 19 13:21:48.283334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 443/810] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:49.098450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:49.100612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:49.107573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:49.108046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:49.108445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:49.109366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:49.109810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:49.110228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:49.142325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-78ab2e07-889e-43be-87e9-f429763e8456 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047831 Oct 19 13:21:49.142927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 368/811] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:49.295269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:49.297701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:49.304790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:49.305305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:49.305731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:49.306431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:49.306877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:49.307299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:49.340452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-506eeaa1-fb8d-4414-aa42-b5c2c14464c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049193 Oct 19 13:21:49.341020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 444/812] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:50.155020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:50.157297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:50.164194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:50.164665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:50.165124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:50.165816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:50.166252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:50.166663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:50.198127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-525f2070-1ed0-454d-b24d-661c2b93f125 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046962 Oct 19 13:21:50.198599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 369/813] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:50.354003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:50.356173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:50.362992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:50.363475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:50.363910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:50.364614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:50.365105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:50.365530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:50.396710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b916df5-59e5-450a-a04a-13e790e5d928 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 Oct 19 13:21:50.397495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 445/814] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:51.211947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:51.214130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:51.221126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:51.221605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:51.222028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:51.222720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:51.223181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:51.223602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:51.258198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-282813de-2fe3-4c69-af55-6b51fc8f80f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050262 Oct 19 13:21:51.258775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 370/815] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:51.409541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:51.411690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:51.418890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:51.419519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:51.420004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:51.420756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:51.421297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:51.421984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:51.453871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9453f913-52c1-4249-a49f-d4342e8c7059 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048341 Oct 19 13:21:51.454464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 446/816] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:52.275733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:52.279426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:52.289982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:52.290882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:52.291686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:52.293044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:52.293891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:52.294665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:52.330862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7473e9ad-63a4-483b-88a4-57850c5bfdda tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061488 Oct 19 13:21:52.331492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 371/817] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:52.466464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:52.468790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:52.476430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:52.476946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:52.477382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:52.478211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:52.478664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:52.479084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:52.511727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8081655a-dffc-43e1-a5ca-85ed2611ec9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049215 Oct 19 13:21:52.512301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 447/818] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:53.344496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:53.346671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:53.356905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:53.357449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:53.357902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:53.358766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:53.359265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:53.359714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:53.394447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0e40cf81-00ec-49a5-86f3-37951ab878e2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054065 Oct 19 13:21:53.395030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 372/819] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:53.528294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:53.530609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:53.537810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:53.538307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:53.538801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:53.540953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:53.540953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:53.540953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:53.576433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3ce4e468-3d85-4fab-81e9-dfca7de7c32b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052062 Oct 19 13:21:53.576946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 448/820] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:21:54.408350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:54.410578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:54.417444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:54.417924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:54.418352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:54.419053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:54.419506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:54.419918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:54.460571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd3012b1-7f5b-4f36-9574-bc3805711a69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056636 Oct 19 13:21:54.461220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 373/821] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:54.589305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:54.591379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:54.598694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:54.599236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:54.599715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:54.600472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:54.601014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:54.601546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:54.659349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a45df200-c04b-44bc-8be2-908c13a72ca1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074015 Oct 19 13:21:54.660396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 449/822] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:55.474414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:55.477137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:55.484898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:55.485378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:55.485812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:55.486529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:55.486976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:55.487398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:55.523043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-65dc121f-0e99-4bb9-9c71-a6b418200202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053222 Oct 19 13:21:55.523623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 374/823] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:21:55.675482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:55.677605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:55.680066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:55.685748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:55.686227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:55.686879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:55.687708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:55.688161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:55.688587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:55.727598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-65c78769-1cd2-4943-af6b-9b9e79a6c451 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056165 Oct 19 13:21:55.728610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 450/824] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:56.539765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:56.543437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:56.547548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:56.557137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:56.557949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:56.558707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:56.559934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:56.560717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:56.561502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:56.597561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:56.622448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee26e85f-9310-4f2c-8b8f-78c2788b0464 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089482 Oct 19 13:21:56.623482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 375/825] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:21:56.744272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:56.746502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:56.753531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:56.754123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:56.754598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:56.755443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:56.755930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:56.756485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:56.789240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e75135f1-94e8-41fa-837c-ec9680ce3bc7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049484 Oct 19 13:21:56.789834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 451/826] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:57.646864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:57.649088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:57.656323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:57.656814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:57.657271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:57.657974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:57.658421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:57.658839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:57.692326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5627a945-e0c0-49a7-a4c0-c61f03fb413f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052685 Oct 19 13:21:57.692953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 376/827] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:57.802001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:57.804253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:57.811670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:57.812727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:57.813196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:57.813919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:57.814368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:57.814792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:57.855891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a7ac46d-5fce-4ad6-af74-75e42a3ef521 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057903 Oct 19 13:21:57.856483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 452/828] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:58.709112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:58.711266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:58.718842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:58.719325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:58.719750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:58.720451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:58.720920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:58.721335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:58.757296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-372c53a8-f60f-44a5-88c6-53247473057b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052217 Oct 19 13:21:58.757883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 377/829] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:21:58.873854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:58.877734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:58.890174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:58.891392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:58.892173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:58.893483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:58.894298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:58.895112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:58.902417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:21:58.934138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a160108b-386b-4b9f-af68-cf08e7da5022 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067899 Oct 19 13:21:58.934739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 453/830] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:21:59.774548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:59.777271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:59.785429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:59.785962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:59.786427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:59.787224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:59.787707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:59.788170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:59.825539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c71ebc3c-da93-4d95-946c-7add69e88165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059368 Oct 19 13:21:59.826027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 378/831] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:21:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:21:59.947199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:21:59.949461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:21:59.957389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:59.957881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:59.958319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:59.959035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:21:59.959491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:21:59.959908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:21:59.995652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a78c531a-5d2c-4414-b0d9-ffeef3a2a818 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052414 Oct 19 13:21:59.996326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 454/832] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:21:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:00.844499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:00.848218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:00.858511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:00.859118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:00.860009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:00.861279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:00.862092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:00.862707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:00.914623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1c95cbc-f10b-4f0b-9829-470f64af5b0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075795 Oct 19 13:22:00.915612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 379/833] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:01.011614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:01.013842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:01.022198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:01.022752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:01.023239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:01.024008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:01.024507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:01.025085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:01.061009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8496c309-8b98-43ac-8a40-2f41e7777824 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054177 Oct 19 13:22:01.061709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 455/834] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:01.932905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:01.937263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:01.948411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:01.948954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:01.949394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:01.950122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:01.950571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:01.950989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:01.988436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3687c133-c1da-4a39-a1be-abe0594bb70b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063284 Oct 19 13:22:01.989081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 380/835] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:02.074561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:02.076921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:02.084439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:02.084957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:02.085405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:02.086116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:02.086567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:02.086988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:02.142900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-445cc221-84b6-415a-990c-dda7d43f923d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072009 Oct 19 13:22:02.143946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 456/836] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:03.001848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:03.004252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:03.011744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:03.012302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:03.012781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:03.013683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:03.014177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:03.014814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:03.046940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd4ed660-3fbf-40ab-8459-1912e48fc160 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049290 Oct 19 13:22:03.047521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 381/837] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:03.157118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:03.159466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:03.167255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:03.167767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:03.168209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:03.169010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:03.169477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:03.169916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:03.203914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-12920f29-a040-4cd5-a9cf-de1d95e91924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051071 Oct 19 13:22:03.204512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 457/838] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:04.060043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:04.062260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:04.075223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:04.075717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:04.076147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:04.076932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:04.077560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:04.077978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:04.112362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b06e9bc8-c902-474d-b30d-4b724417b1fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056393 Oct 19 13:22:04.113001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 382/839] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:04.217190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:04.219690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:04.227402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:04.228012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:04.228378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:04.229122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:04.229555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:04.229999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:04.263931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cc5b8212-d5fe-4522-beac-8b17afe46140 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050854 Oct 19 13:22:04.264677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 458/840] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:05.129406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:05.132850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:05.149862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:05.150356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:05.150801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:05.151512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:05.151986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:05.152453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:05.186018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eecca926-6d8e-4331-8a71-7e936a1297b1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063536 Oct 19 13:22:05.186689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 383/841] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:05.277757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:05.280085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:05.287401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:05.287909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:05.288349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:05.289102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:05.289569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:05.289973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:05.323089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-777fc569-0f8a-4e14-99f0-a38acb6c059f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049276 Oct 19 13:22:05.323698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 459/842] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:06.199389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:06.201506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:06.208406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:06.208896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:06.209400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:06.210153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:06.210599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:06.211012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:06.253787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d482062-c5d3-4277-8e21-9a93ce473fd8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058359 Oct 19 13:22:06.254842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 384/843] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:06.341205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:06.347401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:06.356990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:06.357566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:06.358020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:06.359441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:06.364204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:06.365064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:06.408782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-03eb8279-f64f-49e8-bc70-da8fc2db9b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075260 Oct 19 13:22:06.409410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 460/844] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:07.273295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:07.275475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:07.282753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:07.283226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:07.283677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:07.284386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:07.284839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:07.285294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:07.323136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3fc32d6d-8ebd-4687-b22a-002443af7516 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054026 Oct 19 13:22:07.323777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 385/845] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:07.424226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:07.426481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:07.435711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:07.436290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:07.437061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:07.438061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:07.438526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:07.438950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:07.471479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ef4f5da1-a51a-41a7-be9d-8c165188a843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Oct 19 13:22:07.472059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 461/846] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:08.339506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:08.342474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:08.351351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:08.352006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:08.352616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:08.353690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:08.354387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:08.355005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:08.390300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a01d1a9d-cb02-4679-8e5e-1e25c133d99b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055950 Oct 19 13:22:08.391309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 386/847] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:08.484595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:08.487128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:08.494715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:08.495235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:08.495871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:08.496793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:08.497418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:08.498073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:08.538298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a7b9321a-1386-437f-a121-6bca29fd56a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057638 Oct 19 13:22:08.538866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 462/848] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:09.408412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:09.410775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:09.418024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:09.418503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:09.418933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:09.419619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:09.420062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:09.420476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:09.450632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a31c24d9-1a7f-4814-8289-d30109c68482 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049032 Oct 19 13:22:09.451402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 387/849] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:09.552244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:09.554489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:09.561369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:09.561851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:09.562286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:09.562974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:09.563425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:09.563846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:09.594423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f6f5927a-b9cf-44c1-8955-9fb6df1ff86c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 Oct 19 13:22:09.594909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 463/850] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:10.465359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:10.467500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:10.474437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:10.474907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:10.475327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:10.476004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:10.476443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:10.476852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:10.506798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ececbf2a-a8ba-4284-a4fc-0d2bb1744cf8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045545 Oct 19 13:22:10.507368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 388/851] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:10.612490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:10.614605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:10.621533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:10.622022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:10.622456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:10.623153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:10.623601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:10.624010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:10.654498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-914efb09-face-43b5-ad93-ca03a3b81f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 Oct 19 13:22:10.655058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 464/852] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:11.523206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:11.526355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:11.535300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:11.535776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:11.536205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:11.536905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:11.537376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:11.537794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:11.567767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-82f2b078-56f8-456a-aeae-f7f13d840e94 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050718 Oct 19 13:22:11.568230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 389/853] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:11.671259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:11.674516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:11.684765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:11.685545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:11.686209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:11.687256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:11.687988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:11.688660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:11.718641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f7da98eb-fd23-45f0-ac8c-7cc6f8776008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053602 Oct 19 13:22:11.719201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 465/854] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:12.585901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:12.588727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:12.596952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:12.597579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:12.598099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:12.598986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:12.599569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:12.600059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:12.632426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e91b4e8-48ad-41b8-b64d-6382fd443f6a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051590 Oct 19 13:22:12.633013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 390/855] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:12.734087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:12.737182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:12.744405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:12.744906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:12.745347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:12.746047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:12.746499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:12.746920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:12.778169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-76597c4b-d728-4022-84dc-ee1fef654627 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050186 Oct 19 13:22:12.778727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 466/856] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:13.647945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:13.650355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:13.658284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:13.658986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:13.659423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:13.660117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:13.660567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:13.661018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:13.690600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-77e71ac5-f0b4-4231-8b91-908fb3d7cc55 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047306 Oct 19 13:22:13.691146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 391/857] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:13.793759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:13.796934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:13.806716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:13.807395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:13.808008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:13.809076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:13.809717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:13.810315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:13.842962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0496d93e-b427-4d55-8566-a714dabe0ee3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054940 Oct 19 13:22:13.843522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 467/858] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:14.708098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:14.711506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:14.722627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:14.723555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:14.723800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:14.724495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:14.724968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:14.725387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:14.729110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:14.757761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e8e7ff11-c791-4975-843f-184112cb4708 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056696 Oct 19 13:22:14.758314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 392/859] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:14.856883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:14.860225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:14.867736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:14.868214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:14.868643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:14.869365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:14.869817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:14.870258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:14.903688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4b5f9b07-e0cb-4c76-848d-eb129c5ee339 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050976 Oct 19 13:22:14.904410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 468/860] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:15.774170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:15.776393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:15.783822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:15.784318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:15.784770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:15.785518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:15.785981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:15.786471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:15.817554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5096fc69-b3f3-46da-8cf1-55bfd725f075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048738 Oct 19 13:22:15.818091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 393/861] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:15.922862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:15.926251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:15.937296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:15.938114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:15.938961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:15.940161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:15.940980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:15.941763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:15.967900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:15.973513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d0304e00-68f4-46dd-a9b7-db5d3786d85f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057340 Oct 19 13:22:15.974214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 469/862] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:16.834890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:16.839411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:16.849849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:16.850255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:16.850710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:16.851434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:16.851967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:16.852416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:16.884794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c0b8f554-8a09-4d84-bfd0-7b1166e5bf5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056906 Oct 19 13:22:16.885407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 394/863] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:16.986893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:16.989070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:16.996324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:16.996812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:16.997300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:16.997999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:16.998449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:16.998873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:17.029354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd5488d4-a54e-4987-953d-edb6e72ed11f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046624 Oct 19 13:22:17.030040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 470/864] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:17.902311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:17.904477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:17.911485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:17.911960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:17.912662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:17.913394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:17.913826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:17.914240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:17.949193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eff92999-28c6-48eb-b674-8ed5770545e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051559 Oct 19 13:22:17.950130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 395/865] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:18.045514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:18.048638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:18.056899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:18.057397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:18.057827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:18.058550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:18.058996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:18.059417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:18.090430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4a7a9ea4-5899-4540-8c84-935ef53e099c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051279 Oct 19 13:22:18.090977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 471/866] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:18.964442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:18.966965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:18.975532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:18.976001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:18.976422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:18.977159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:18.977603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:18.978005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:19.009338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-584d48ca-0ce1-4331-8c41-a279a7065927 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050015 Oct 19 13:22:19.009892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 396/867] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:19.107218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:19.110053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:19.117838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:19.118403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:19.118904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:19.119695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:19.120218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:19.120703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:19.153034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd5e4eb9-6363-450e-83b8-526422e4f574 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Oct 19 13:22:19.153602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 472/868] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:20.024166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:20.026442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:20.033669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:20.034180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:20.034625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:20.035348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:20.035812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:20.036249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:20.067767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-60bdc405-86da-4338-a503-86242769aae4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048948 Oct 19 13:22:20.068318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 397/869] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:20.170899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:20.174446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:20.182696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:20.183186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:20.183626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:20.184325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:20.184782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:20.185250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:20.214790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-86e0a41f-6971-46bb-8edb-312a861f690a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051125 Oct 19 13:22:20.215261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 473/870] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:21.083330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:21.086478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:21.096117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:21.096795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:21.097458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:21.098432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:21.099070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:21.099716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:21.130085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3995bfd1-c86e-4918-a1af-d5856f081d7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052498 Oct 19 13:22:21.130733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 398/871] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:21.231667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:21.235006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:21.245423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:21.246125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:21.246830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:21.247886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:21.248626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:21.249501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:21.291478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-22f5d7db-ecf2-456a-8680-488516670812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066561 Oct 19 13:22:21.292061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 474/872] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:22.147467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:22.151062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:22.162337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:22.162814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:22.163245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:22.163931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:22.164379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:22.165015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:22.195586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12f6ab2b-b2b2-4a30-bca7-02f8eea0e2eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055508 Oct 19 13:22:22.196124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 399/873] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:22.304474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:22.306768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:22.314131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:22.314665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:22.315021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:22.315719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:22.316187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:22.316583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:22.348821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28fb5b37-9614-4ee0-91d9-b59eec40ec64 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048675 Oct 19 13:22:22.349395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 475/874] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:23.209817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:23.211936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:23.219080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:23.219567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:23.220003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:23.220706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:23.221187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:23.221607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:23.252302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-44ade76f-d213-4bf2-8faf-a36d88866b84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047717 Oct 19 13:22:23.252879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 400/875] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:23.366361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:23.374013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:23.384124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:23.384633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:23.385128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:23.385862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:23.386342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:23.386786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:23.419712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd552a43-f233-414a-8d7d-3af486af73d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060300 Oct 19 13:22:23.420298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 476/876] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:24.269658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:24.273178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:24.284607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:24.285477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:24.286164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:24.287341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:24.288084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:24.288737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:24.319381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-698d6aa4-8b2a-4456-aa21-b3c242bb9185 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056829 Oct 19 13:22:24.320043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 401/877] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:24.433415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:24.435606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:24.442947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:24.443427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:24.443864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:24.444630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:24.445388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:24.445857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:24.481857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb7c7da1-e536-4595-a23c-d4fdb811f95f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052792 Oct 19 13:22:24.482460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 477/878] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:25.334208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:25.336510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:25.343458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:25.343934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:25.344367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:25.345068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:25.345515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:25.345930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:25.377595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ffebb2af-fed2-4694-86f4-fd6ea6421344 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047445 Oct 19 13:22:25.378166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 402/879] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:25.495469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:25.497638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:25.504707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:25.505315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:25.505804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:25.506502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:25.506963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:25.507384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:25.539310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-23107022-ef2e-4a19-930c-c18df5ad90a6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Oct 19 13:22:25.539877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 478/880] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:26.395554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:26.399091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:26.410113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:26.410893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:26.411590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:26.412708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:26.413479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:26.414240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:26.444075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd9b997e-d88e-450b-9ba6-6898fb5773ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055654 Oct 19 13:22:26.444632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 403/881] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:26.552377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:26.554939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:26.557379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:26.563007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:26.563483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:26.563914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:26.564606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:26.565086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:26.565504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:26.607090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d5fcc2b-3bca-451d-9e35-e6566eba8ef3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058684 Oct 19 13:22:26.607571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 479/882] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:27.457212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:27.459351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:27.461775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:27.467790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:27.468271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:27.468684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:27.469401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:27.469845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:27.470261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:27.501382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5c8eaa44-e5a9-4801-b63a-73fe305c3145 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048387 Oct 19 13:22:27.502196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 404/883] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:27.624378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:27.626997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:27.635483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:27.636132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:27.636680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:27.637595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:27.638177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:27.638708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:27.670777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c65f63c-ed0b-4617-a74c-80edb244c6a8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051194 Oct 19 13:22:27.670983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 480/884] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:28.515236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:28.517888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:28.524898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:28.525425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:28.525885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:28.526589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:28.527035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:28.527459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:28.559769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-82ae6304-3dd3-496b-bf46-52557f984262 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048870 Oct 19 13:22:28.560332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 405/885] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:28.683103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:28.685339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:28.692323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:28.692818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:28.693299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:28.693988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:28.694426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:28.694849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:28.725498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6d55daa5-0657-4ed3-8721-417bbc0dec83 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Oct 19 13:22:28.726080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 481/886] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:29.572893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:29.575212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:29.581993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:29.582472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:29.582907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:29.583604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:29.584050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:29.584451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:29.615167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6773884b-7f68-4a2f-af0d-7d86f1b205f3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 Oct 19 13:22:29.615737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 406/887] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:29.741752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:29.744359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:29.751194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:29.751671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:29.752100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:29.752783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:29.753264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:29.753677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:29.784111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-64e97647-d99d-4b04-980f-c66f8b0cdcec tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048414 Oct 19 13:22:29.784664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 482/888] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:30.629259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:30.631416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:30.637909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:30.638391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:30.638822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:30.639541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:30.640354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:30.640771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:30.671482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b599ba3e-0bd8-42c9-a5ee-84c55e8fd018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047400 Oct 19 13:22:30.672247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 407/889] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:30.796966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:30.799146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:30.805759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:30.806242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:30.806673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:30.807367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:30.807809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:30.808224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:30.838605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39b67cee-34a4-4091-8f42-47d2dbc1908c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Oct 19 13:22:30.839187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 483/890] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:31.685121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:31.688448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:31.697383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:31.697873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:31.698305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:31.699012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:31.699460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:31.699886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:31.734310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:31.739433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fc203ab8-e050-490b-b653-670e85af78ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058993 Oct 19 13:22:31.740008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 408/891] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:31.851578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:31.853880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:31.860706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:31.861204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:31.861634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:31.862333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:31.862766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:31.863180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:31.894718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-69a5a385-7785-4769-a668-6bf245cc955e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Oct 19 13:22:31.895295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 484/892] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:32.754093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:32.756253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:32.764630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:32.765802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:32.766481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:32.767629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:32.768403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:32.769147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:32.802656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4d659e2-4610-4c53-a4c4-8b206b03a565 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053265 Oct 19 13:22:32.803205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 409/893] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:32.907857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:32.910054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:32.917088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:32.917576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:32.918008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:32.918709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:32.919187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:32.919611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:32.950412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-05288c24-7d8e-4138-8cd3-2d6bec970634 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046653 Oct 19 13:22:32.950987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 485/894] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:33.816924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:33.819179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:33.827027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:33.827522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:33.827944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:33.828662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:33.829151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:33.829576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:33.861272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a386d7e0-91df-4e18-921a-95489f7bb6d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048571 Oct 19 13:22:33.861833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 410/895] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:33.964591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:33.966310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:33.974243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:33.974981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:33.975572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:33.976553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:33.977041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:33.977708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:33.996508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:34.009841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a95b3a9c-606b-4fd9-97ec-6e4157870bc9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 Oct 19 13:22:34.010421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 486/896] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:34.878240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:34.881311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:34.888420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:34.889078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:34.890177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:34.890962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:34.891476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:34.891960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:34.923580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9f2a707e-3d5d-4131-806f-034afb00f5d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050492 Oct 19 13:22:34.924335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 411/897] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:35.024168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:35.026442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:35.033393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:35.033851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:35.034290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:35.034982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:35.035439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:35.035872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:35.066966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-82a981d5-c348-4cf2-a1e3-5a409c6232c5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Oct 19 13:22:35.067526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 487/898] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:35.936924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:35.939082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:35.946056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:35.946527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:35.947150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:35.947847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:35.948292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:35.948706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:35.980501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-436446fb-e5e7-479b-aac9-5594a59fca43 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047818 Oct 19 13:22:35.981114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 412/899] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:36.084806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:36.087004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:36.094006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:36.094488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:36.094918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:36.095606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:36.096053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:36.096467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:36.125776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9f0fb045-1de2-4ab3-8193-142de245755b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Oct 19 13:22:36.126311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 488/900] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:36.997450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:37.000125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:37.010034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:37.010499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:37.010930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:37.011653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:37.012101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:37.012537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:37.044807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bc609ebd-a414-41bb-9eaa-e3033b070393 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054114 Oct 19 13:22:37.045393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 413/901] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:37.140888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:37.144067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:37.153053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:37.153625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:37.154045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:37.154927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:37.155399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:37.155806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:37.194457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af837e81-3370-4250-8e9c-8d18605c1bcc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059581 Oct 19 13:22:37.195047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 489/902] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:38.058226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:38.060394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:38.067306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:38.067781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:38.068203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:38.068896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:38.069365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:38.069780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:38.099884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6c1a9da0-29c7-4349-a761-61777c031397 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Oct 19 13:22:38.100436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 414/903] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:38.209300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:38.211435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:38.220923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:38.221606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:38.222272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:38.223485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:38.224141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:38.224750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:38.257608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dfe8f68c-8bdc-4d9b-90ae-cde3796ab2d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052308 Oct 19 13:22:38.258173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 490/904] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:39.116811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:39.120215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:39.127335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:39.127807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:39.128230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:39.128898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:39.129376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:39.129789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:39.161370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6dcfee08-8523-44bb-bb13-5fc7de94c800 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051209 Oct 19 13:22:39.161930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 415/905] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:39.271415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:39.274721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:39.282703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:39.283198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:39.283632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:39.284338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:39.284800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:39.285268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:39.318652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9c5e7e21-15e5-42d2-a1fe-eb49056e8491 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051313 Oct 19 13:22:39.319239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 491/906] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:40.178731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:40.182044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:40.193619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:40.194402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:40.195108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:40.196231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:40.196978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:40.197690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:40.228550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-33c4b582-0f3b-4607-a0b6-5f8508c631d1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056609 Oct 19 13:22:40.229124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 416/907] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:40.332013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:40.334243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:40.341258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:40.341742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:40.342167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:40.342880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:40.343332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:40.343737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:40.374562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6c14b0fa-830d-433d-a9d0-da5b6eafdd5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Oct 19 13:22:40.375117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 492/908] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:41.246723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:41.248920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:41.256063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:41.256545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:41.257018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:41.257725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:41.258159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:41.258575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:41.292366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-051d2ce7-0455-479c-bceb-7580024be53d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052301 Oct 19 13:22:41.293028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 417/909] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:41.387744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:41.390266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:41.396946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:41.397430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:41.397869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:41.398547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:41.398986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:41.399401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:41.429177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9824b35e-0a05-491f-8fc7-37d03d89316c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Oct 19 13:22:41.429759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 493/910] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:42.311009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:42.313434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:42.320992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:42.321524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:42.322006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:42.322777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:42.323273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:42.323860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:42.357220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c5a7d5c6-290c-4fbc-b1cb-11a21e3a7e19 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052872 Oct 19 13:22:42.357875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 418/911] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:42.446858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:42.450406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:42.457513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:42.458001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:42.458430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:42.459122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:42.459569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:42.459988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:42.496071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b3c5b3e5-5da1-4886-8ab4-2c175062f1b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057310 Oct 19 13:22:42.496967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 494/912] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:43.371456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:43.374038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:43.384053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:43.384822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:43.385627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:43.386918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:43.387651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:43.388145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:43.420729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c611733e-422b-4cc5-bf0d-a34c2c125f0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053964 Oct 19 13:22:43.421313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 419/913] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:43.511710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:43.514154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:43.521510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:43.522000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:43.522436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:43.523147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:43.523604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:43.524035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:43.554055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3aeacc15-329b-42e1-b598-4536c9a36108 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Oct 19 13:22:43.554624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 495/914] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:44.434271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:44.436387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:44.443743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:44.444217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:44.444640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:44.445391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:44.445830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:44.446239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:44.480183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a122f79d-5c79-4f24-8e11-10e77d395627 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049937 Oct 19 13:22:44.480648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 420/915] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:44.567519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:44.569693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:44.577273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:44.577713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:44.578160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:44.578843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:44.579285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:44.579902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:44.611333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51592aba-29be-4876-ab08-a98c79e80248 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047833 Oct 19 13:22:44.611926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 496/916] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:45.495552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:45.497644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:45.499790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:22:45.499935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:22:45.506166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:45.506634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:45.507078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:45.507746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:45.508191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:45.508603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:45.540905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b67a9366-9b82-4ff0-a9e9-1894220ca436 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049412 Oct 19 13:22:45.541456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 421/917] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:45.624466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:45.626623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:45.628654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:22:45.628799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:22:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:22:45.640958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:45.641617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:45.642059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:45.642769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:45.643231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:45.643656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:45.678150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8d635053-94a7-433f-befd-6bfbde8d0c5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057934 Oct 19 13:22:45.678750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 497/918] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:46.554245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:46.556427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:46.563711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:46.564194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:46.564620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:46.565363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:46.565813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:46.566227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:46.597279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a1eb8487-a86c-4655-960b-222278cc97a2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047165 Oct 19 13:22:46.597849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 422/919] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:46.691143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:46.693356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:46.700252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:46.700734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:46.701254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:46.702050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:46.702499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:46.702916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:46.733769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c39bbef5-54a1-48fd-a75f-6ad70d12172e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Oct 19 13:22:46.734333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 498/920] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:47.613972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:47.617424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:47.628182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:47.628949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:47.629652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:47.630765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:47.631462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:47.632119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:47.673887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d7791c4b-3976-439b-95b1-7c5952525996 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066291 Oct 19 13:22:47.674452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 423/921] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:47.746233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:47.748544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:47.755479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:47.755978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:47.756416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:47.757153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:47.757607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:47.758033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:47.790964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52b0d1dd-68cf-42e9-a287-93cb6ffd1e2e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048657 Oct 19 13:22:47.791577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 499/922] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:48.687763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:48.689998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:48.697014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:48.697523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:48.697978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:48.698675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:48.699166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:48.699681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:48.731120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-253e1317-4e16-47f7-803e-53d67ecbbd86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047862 Oct 19 13:22:48.732551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 424/923] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:48.807871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:48.810304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:48.817188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:48.817724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:48.818205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:48.818960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:48.819448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:48.819901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:48.853171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d3ee91b-673d-42ca-aed1-6c81fdd80c5b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051971 Oct 19 13:22:48.853742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 500/924] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:49.744790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:49.746938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:49.753714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:49.754189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:49.754610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:49.755617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:49.756057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:49.756510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:49.774950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:49.789107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-30d4041b-e949-43ae-afd3-7bb5d9e2464a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048517 Oct 19 13:22:49.789671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 425/925] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:49.866642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:49.868758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:49.875241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:49.875721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:49.876156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:49.876880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:49.877334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:49.877753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:49.910260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-99f346f2-153a-404f-a52b-411e2fea8678 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Oct 19 13:22:49.910870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 501/926] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:50.802287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:50.804402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:50.811380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:50.811855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:50.812279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:50.813082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:50.813563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:50.813993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:50.844629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0e4f7914-051f-415f-b8c8-621bde7142d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046293 Oct 19 13:22:50.845129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 426/927] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:50.924571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:50.926755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:50.928782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:22:50.928967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:22:50.935829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:50.936350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:50.936798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:50.937511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:50.937968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:50.938369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:50.970975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-90da2657-44a8-4f1d-821f-95767af9c61d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050567 Oct 19 13:22:50.971571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 502/928] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:51.858037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:51.860074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:51.866959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:51.867432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:51.867855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:51.868543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:51.869024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:51.869438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:51.901312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5da48b47-de5d-444c-a0f6-1908ac42a1ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047638 Oct 19 13:22:51.901869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 427/929] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:51.984776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:51.987005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:51.993896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:51.994379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:51.994807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:51.995497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:51.995917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:51.996360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:52.000243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:52.027467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-841b54b0-16d2-45cc-bc94-aec6c272839d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047388 Oct 19 13:22:52.028032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 503/930] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:52.914737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:52.916801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:52.926002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:52.926476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:52.926899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:52.927601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:52.928043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:52.928458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:52.973559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-16882771-22f7-4f4a-a445-041769907ec2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062873 Oct 19 13:22:52.974127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 428/931] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:53.040434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:53.042670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:53.049652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:53.050140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:53.050579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:53.051276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:53.051735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:53.052155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:53.084679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b9db653a-1170-43bf-a212-9d698a1d6e09 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048164 Oct 19 13:22:53.085317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 504/932] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:53.987755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:53.990078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:53.997008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:53.997884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:53.998332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:53.999025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:53.999471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:53.999886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:54.030910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-20c05596-e140-4fbc-9e08-d3805cc91687 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047682 Oct 19 13:22:54.031484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 429/933] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:54.101870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:54.105421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:54.116665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:54.117532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:54.118259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:54.119410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:54.120305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:54.121083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:54.152691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b0268872-9517-4f99-b880-9058f10befaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057820 Oct 19 13:22:54.153265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 505/934] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:22:55.044544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:55.046790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:55.056637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:55.057510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:55.058229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:55.059411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:55.060323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:55.060805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:55.092356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3aed62c9-cdc9-49b7-b33f-ba1ebbbb64c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052013 Oct 19 13:22:55.092924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 430/935] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:55.168128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:55.171203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:55.178216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:55.178708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:55.179140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:55.179835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:55.180282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:55.180705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:55.211208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a0acdb5b-401a-462c-8776-4ebc433564be tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Oct 19 13:22:55.211803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 506/936] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:56.105624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:56.108234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:56.119447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:56.119937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:56.120386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:56.121142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:56.121579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:56.121973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:56.158509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-abd892d0-5b3d-4715-a3a8-404cf7a34420 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056831 Oct 19 13:22:56.159091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 431/937] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:56.224190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:56.226471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:56.233934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:56.234472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:56.234903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:56.235597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:56.236048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:56.236487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:56.267496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f95cccff-8873-4349-aefb-d285132e3b2a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Oct 19 13:22:56.268077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 507/938] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:57.172327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:57.174954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:57.181909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:57.182386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:57.182817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:57.183502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:57.183940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:57.184346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:57.214945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aa4b3745-1d40-4b80-88e9-c25c04842a8b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047385 Oct 19 13:22:57.215503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 432/939] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:57.280487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:57.283015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:57.285664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:57.293904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:57.294536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:57.295514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:57.296059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:57.296751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:57.300293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:57.332547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-34b8198d-b1d9-409b-a5fd-5ea87b84ceea tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056510 Oct 19 13:22:57.333191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 508/940] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:58.228192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:58.230247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:58.232731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:22:58.238134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:58.240409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:58.240841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:58.241584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:58.242027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:58.242440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:58.276232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00becab0-19b1-4dcb-b3c0-906ece7be951 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052183 Oct 19 13:22:58.276787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 433/941] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:58.346081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:58.348230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:58.355142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:58.355627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:58.356065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:58.356995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:58.357554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:58.357983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:58.389105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b3b9274-5745-415d-a3b0-344de203d861 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Oct 19 13:22:58.390011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 509/942] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:22:59.294432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:59.296577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:59.305936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:59.306401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:59.306858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:59.307597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:59.308045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:59.308441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:59.342022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-72ffce22-71ee-4895-8d73-084974b0f67a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053735 Oct 19 13:22:59.342615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 434/943] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:22:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:22:59.402522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:22:59.404674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:22:59.411931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:59.412418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:59.412849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:59.413584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:22:59.414029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:22:59.414447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:22:59.445774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cd472221-f66b-4443-b6a9-bbaa35feaa0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047258 Oct 19 13:22:59.446341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 510/944] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:22:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:00.355185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:00.357971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:00.368849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:00.369647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:00.370282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:00.371349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:00.372080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:00.372786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:00.407413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5bf1d807-5a96-4d45-8567-d1c2fd083fe1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055798 Oct 19 13:23:00.407993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 435/945] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:00.462519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:00.464780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:00.472222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:00.472713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:00.473180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:00.473896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:00.474349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:00.474773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:00.507259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-db0bf6e9-f865-4812-8cb4-5746e72c0fa2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048887 Oct 19 13:23:00.507738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 511/946] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:01.420247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:01.422461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:01.429328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:01.429799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:01.430226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:01.430895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:01.431355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:01.431765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:01.463199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5d2abb6a-e0e9-4b24-9c0c-1fc4150613f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 Oct 19 13:23:01.463775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 436/947] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:01.522282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:01.525696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:01.534803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:01.535503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:01.536059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:01.537090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:01.537736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:01.538446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:01.574214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d8dc183-2896-4309-8555-3cb9d3fea246 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057696 Oct 19 13:23:01.574958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 512/948] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:02.480747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:02.484246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:02.491836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:02.492294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:02.492747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:02.493482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:02.493931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:02.494349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:02.526819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3a707e95-bef5-4e3b-b682-a1bda214eb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052783 Oct 19 13:23:02.527371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 437/949] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:02.591377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:02.594180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:02.601504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:02.601995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:02.602431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:02.603133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:02.603586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:02.604008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:02.637710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f1e23b48-3a0c-4cd1-bb7c-ed35878a6751 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051119 Oct 19 13:23:02.638528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 513/950] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:03.539972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:03.542177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:03.548904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:03.549384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:03.549817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:03.550515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:03.550963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:03.551379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:03.582953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7c89798c-22e4-41c2-a37c-62f3b14d4640 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046802 Oct 19 13:23:03.583410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 438/951] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:03.651567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:03.653748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:03.661752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:03.662236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:03.662694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:03.663392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:03.663859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:03.664264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:03.697680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e2bbb037-c27b-499d-ab0f-694053f1a9ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050218 Oct 19 13:23:03.698285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 514/952] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:04.599301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:04.602110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:04.610553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:04.611222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:04.611785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:04.612633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:04.613119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:04.613577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:04.645828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ece5994d-e85c-43b8-9eab-ecabc5ceb124 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052474 Oct 19 13:23:04.646395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 439/953] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:04.711736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:04.713939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:04.723537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:04.724050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:04.724483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:04.725245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:04.725698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:04.726119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:04.762418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f77253f1-cf8b-42de-a212-9e1e4355e16b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055145 Oct 19 13:23:04.763008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 515/954] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:05.661759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:05.663502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:05.665578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:23:05.665717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:23:05.672398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:05.672904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:05.673343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:05.674037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:05.674470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:05.675470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:05.715744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f0d1cfd6-e089-4ae2-ba3c-46152f6057e8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059762 Oct 19 13:23:05.716464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 440/955] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:05.776271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:05.778463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:05.786124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:05.786620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:05.787062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:05.787783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:05.788241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:05.788666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:05.820267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b244c5e6-ca2b-4809-824f-35ae2169878b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047953 Oct 19 13:23:05.820834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 516/956] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:06.729873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:06.732049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:06.741261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:06.741739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:06.742262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:06.743047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:06.743587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:06.744361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:06.790648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-034cb7f0-2d0d-4363-9031-10d4379410a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064445 Oct 19 13:23:06.791575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 441/957] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:06.833327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:06.835419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:06.843451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:06.843964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:06.844403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:06.845156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:06.845612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:06.846035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:06.883150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b0be43ad-6676-424b-9a47-5e8675081610 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054156 Oct 19 13:23:06.883739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 517/958] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:07.807593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:07.811001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:07.819181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:07.819687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:07.820116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:07.820810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:07.821283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:07.821698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:07.826390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:07.856447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6dc4755d-8b37-4463-ba38-acafbd3b326b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055451 Oct 19 13:23:07.857068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 442/959] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:07.896939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:07.899011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:07.906277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:07.906762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:07.907199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:07.907894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:07.908439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:07.909066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:07.940968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8431c428-f127-4b2e-8c3a-79d3b31e9f75 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048415 Oct 19 13:23:07.941516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 518/960] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:08.869816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:08.871931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:08.879054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:08.879532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:08.879950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:08.880640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:08.881115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:08.881525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:08.913926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-106a6f91-efb4-410d-a0dd-8f75a9a32162 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048106 Oct 19 13:23:08.914564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 443/961] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:08.953771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:08.955915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:08.962705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:08.963183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:08.963615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:08.964300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:08.964742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:08.965189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:08.990473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:08.995920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4fa82588-ec1f-4545-8ab0-cde10979b774 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Oct 19 13:23:08.996488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 519/962] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:09.927340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:09.929540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:09.936427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:09.936902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:09.937334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:09.938032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:09.938478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:09.938901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:09.971251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a64a6928-b6c2-4ace-942f-aae933c48752 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048358 Oct 19 13:23:09.972481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 444/963] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:10.008691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:10.010852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:10.018607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:10.019332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:10.019985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:10.020698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:10.021191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:10.021620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:10.052747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d5864ccb-5668-43a3-bc77-3c9dcde75cd6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Oct 19 13:23:10.053381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 520/964] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:10.988197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:10.992294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:11.004775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:11.005596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:11.006029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:11.006702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:11.007425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:11.007931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:11.041530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-751158e5-ce2c-450e-ad48-6c4191ff22e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061142 Oct 19 13:23:11.042086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 445/965] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:11.067684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:11.069840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:11.076810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:11.077318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:11.077748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:11.078430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:11.078876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:11.079290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:11.116250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fa780b14-3763-4129-8d8c-b2f47c0f8f05 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054200 Oct 19 13:23:11.116808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 521/966] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:12.054582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:12.056712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:12.063545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:12.064020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:12.064459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:12.065177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:12.065619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:12.066120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:12.096114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a311cfd6-d1cc-4363-8cbb-a8eb1e4f382c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045652 Oct 19 13:23:12.096670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 446/967] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:12.129201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:12.131262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:12.137809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:12.138284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:12.138710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:12.139744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:12.140184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:12.140624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:12.169827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7faa205f-0a5e-4cd5-a16f-eb291e28d54b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Oct 19 13:23:12.170363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 522/968] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:13.113181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:13.116746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:13.127568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:13.128350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:13.129235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:13.130040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:13.130492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:13.130916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:13.161148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b71e4bcd-17ff-46be-be6f-4f063974750a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054729 Oct 19 13:23:13.161696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 447/969] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:13.185347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:13.188792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:13.197255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:13.197735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:13.198166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:13.198865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:13.199310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:13.199726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:13.229436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b53bcfc6-1524-473d-b5b8-c2548d1f33f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050998 Oct 19 13:23:13.229906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 523/970] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:14.177744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:14.180337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:14.187298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:14.187775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:14.188197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:14.188853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:14.189359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:14.189773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:14.221275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b5a2fbbb-c56b-43a5-a586-9f4ace62370b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050127 Oct 19 13:23:14.221832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 448/971] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:14.243494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:14.245893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:14.252853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:14.253373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:14.253828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:14.254515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:14.254968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:14.255395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:14.286756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f0326be2-4f6d-426c-8164-5ae6dba275ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048942 Oct 19 13:23:14.287299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 524/972] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:15.238873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:15.242335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:15.253280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:15.254120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:15.254841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:15.255988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:15.256727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:15.257395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:15.288247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d902d158-a479-43a1-ad1b-a2bd6be59c10 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056399 Oct 19 13:23:15.288967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 449/973] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:15.300352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:15.302546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:15.309229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:15.309712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:15.310144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:15.310834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:15.311278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:15.311692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:15.342418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-25bc12ce-1e1f-4e64-ba99-1b2a05f974d5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046722 Oct 19 13:23:15.342899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 525/974] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:16.301637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:16.303784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:16.311203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:16.311686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:16.312122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:16.312826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:16.313320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:16.313749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:16.345491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c8910974-8e2a-429e-8bf9-7d85b8d35303 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047941 Oct 19 13:23:16.346039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 450/975] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:16.359412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:16.362668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:16.371391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:16.371866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:16.372295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:16.372989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:16.373457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:16.373877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:16.404899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b6bdf49-2a5c-4156-85cf-7b18fffb4dd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051235 Oct 19 13:23:16.405468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 526/976] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:17.360671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:17.363020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:17.370480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:17.370995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:17.371483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:17.372257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:17.372778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:17.373288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:17.406601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-32aa9b25-b95b-4c74-a104-e91b514e1b22 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050683 Oct 19 13:23:17.407160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 451/977] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:17.418685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:17.420903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:17.427998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:17.428479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:17.428916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:17.429641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:17.430095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:17.430516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:17.461069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-622d87c7-cfd3-47b4-a082-55cefb832c37 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Oct 19 13:23:17.461952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 527/978] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:18.427280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:18.429654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:18.437452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:18.438016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:18.438510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:18.439239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:18.439725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:18.440226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:18.471114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ba461ce0-c8eb-42ae-b271-9aaa48bc6188 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048324 Oct 19 13:23:18.471737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 452/979] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:18.474867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:18.477824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:18.487691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:18.488329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:18.489115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:18.490196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:18.490882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:18.491430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:18.521408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1bb82c80-e900-420b-b837-d475443ef9ed tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050753 Oct 19 13:23:18.521929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 528/980] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:19.485590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:19.487794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:19.494827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:19.495869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:19.496390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:19.497132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:19.497634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:19.498060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:19.530205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-10875ec6-c606-409a-930a-4c5f37550c4b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050219 Oct 19 13:23:19.530773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 453/981] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:19.534137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:19.537182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:19.545626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:19.546102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:19.546533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:19.547220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:19.547668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:19.548084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:19.584623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e5e2cb35-edba-480e-b21a-ada5b4840250 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054330 Oct 19 13:23:19.585258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 529/982] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:20.542422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:20.544693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:20.551322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:20.551801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:20.552245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:20.552990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:20.553406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:20.553823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:20.584249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-20ff1945-8d76-4a12-b715-7b753c60d4f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045906 Oct 19 13:23:20.584688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 454/983] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:20.597509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:20.599672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:20.606539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:20.607022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:20.607449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:20.608428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:20.608956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:20.609317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:20.647320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aaaf4a0b-033f-4ab2-8ec3-363fa86dc391 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053709 Oct 19 13:23:20.648019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 530/984] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:21.597602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:21.599744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:21.606645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:21.607119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:21.607536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:21.608224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:21.608663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:21.609130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:21.639098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d6aadef9-9879-41b7-8b5e-27a66a0b1bcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045156 Oct 19 13:23:21.639635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 455/985] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:21.663549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:21.666416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:21.676241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:21.677011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:21.677607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:21.678611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:21.679300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:21.679874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:21.712090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c5b907d-4f79-418c-a71a-a94d155a43d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055026 Oct 19 13:23:21.712648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 531/986] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:22.652765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:22.655153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:22.664513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:22.665051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:22.665516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:22.666226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:22.666671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:22.667119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:22.697879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa9d4ee1-a02b-4559-993c-bd642375c8b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049581 Oct 19 13:23:22.698430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 456/987] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:22.728849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:22.732232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:22.739126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:22.739781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:22.740234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:22.740955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:22.741407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:22.741822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:22.776771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4855b8b5-c5ec-4b71-a268-b220bd29f189 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054208 Oct 19 13:23:22.777360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 532/988] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:23.711470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:23.713671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:23.720302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:23.720769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:23.721220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:23.721903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:23.722339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:23.722749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:23.752112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-78694b43-1d1e-4c71-a8fc-3922f20381b8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044690 Oct 19 13:23:23.752654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 457/989] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:23.789564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:23.791688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:23.798416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:23.798890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:23.799323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:23.800007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:23.800448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:23.800886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:23.830756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e7681150-b496-479f-a84f-00e0ab553e41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Oct 19 13:23:23.831306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 533/990] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:24.765112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:24.767166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:24.775641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:24.776125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:24.776548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:24.777262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:24.777700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:24.778102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:24.803652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:24.808555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d1aab8c3-7f22-4de0-bd6f-89ad72ac229b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048407 Oct 19 13:23:24.809150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 458/991] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:24.843549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:24.845837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:24.853045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:24.853549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:24.853956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:24.854635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:24.855095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:24.855516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:24.885929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3e99382e-a225-4cb9-80f9-31daa8c7932a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Oct 19 13:23:24.886472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 534/992] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:25.822048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:25.824199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:25.831583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.832063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.832487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.833199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.833677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.834074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.852381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:25.852993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:25.859344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.859804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.860226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.860946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.861388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.861800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.864487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0cd84c1f-6bec-49f2-8f7f-2a9fc93e738c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046537 Oct 19 13:23:25.865086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 459/993] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:25.901559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:25.903693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:25.910158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.910655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.911069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.911747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:25.912178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:25.912570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:25.943604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0450c39c-bd3f-4e5f-b4dc-8062d6a55080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047757 Oct 19 13:23:25.944232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 460/994] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:25.948871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lazy-loading 'services' on Instance uuid 0bb468a8-83a3-4574-859c-72e04d9ab535 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:23:26.019699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:26.033638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-878482fb-b117-449c-a6ef-6da7cdbb8f6f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535/os-volume_attachments/e18cc3ff-ad89-4bae-80a9-4fda2206a1b2" status: 202 len: 0 microversion: 2.1 time: 0.184987 Oct 19 13:23:26.034227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 535/995] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:23:25 2022] DELETE /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535/os-volume_attachments/e18cc3ff-ad89-4bae-80a9-4fda2206a1b2 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 13:23:26.877275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:26.879405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:26.885915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:26.886323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:26.886745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:26.887422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:26.887861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:26.888264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:26.919295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb0e72bc-97aa-4e67-baf1-bd303496819d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046021 Oct 19 13:23:26.919845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 461/996] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:26.957718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:26.959999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:26.966704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:26.967217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:26.967645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:26.968501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:26.968897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:26.969320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:27.001761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-31d9bc49-cd44-4eaa-9660-44f8a70850a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Oct 19 13:23:27.002331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 536/997] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:27.939081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:27.941113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:27.948892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:27.949435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:27.949892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:27.950607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:27.951060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:27.951478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:27.981913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0177e731-6a3c-41e7-b7ac-872186eb45de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047788 Oct 19 13:23:27.982506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 462/998] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:28.014502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:28.017074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:28.019644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:28.025416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:28.025907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:28.026354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:28.027039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:28.027491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:28.027935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:28.059490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9aebc2e5-d13c-45e1-a4c8-795a6225abde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049340 Oct 19 13:23:28.060047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 537/999] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:29.002512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:29.004680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:29.007371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=60 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:29.012949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:29.013990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:29.014418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:29.015106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:29.015550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:29.015967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:29.047690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7af94226-e9d3-43a3-82f6-8f3aa42956df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049170 Oct 19 13:23:29.048636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 463/1000] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:29.071732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:29.073975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:29.080829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:29.081199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:29.081629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:29.082377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:29.082849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:29.083266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:29.114260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-68ee3247-a590-4933-af25-26848f016232 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Oct 19 13:23:29.114832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 538/1001] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:30.060711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:30.062933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:30.069887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:30.070375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:30.070803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:30.071632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:30.071932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:30.072349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:30.102809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a3b97cad-5498-415b-ac35-04002ba8d0cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Oct 19 13:23:30.103363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 464/1002] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:30.127119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:30.129566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:30.136466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:30.136984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:30.137419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:30.138112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:30.138911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:30.139376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:30.168583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-740b3d22-5da3-4c73-9d26-a5e233bb118c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Oct 19 13:23:30.169426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 539/1003] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:31.115642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:31.118487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:31.125252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:31.125669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:31.127446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:31.128036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:31.128496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:31.128894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:31.162232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fc1eefb8-bfc2-4ec9-8d56-72ecb95a3b80 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050668 Oct 19 13:23:31.162892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 465/1004] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:31.181553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:31.183698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:31.190202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:31.190690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:31.191127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:31.191833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:31.192359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:31.193155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:31.222943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-38950a9b-e8e5-4d4a-92b6-350ffe0dbd76 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Oct 19 13:23:31.223557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 540/1005] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:32.175374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:32.178025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:32.185401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:32.186203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:32.186811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:32.187512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:32.187981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:32.188385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:32.219655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5269f254-c9cf-4fe1-933b-8cbe051750ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048457 Oct 19 13:23:32.220464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 466/1006] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:32.235976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:32.238328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:32.245455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:32.245854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:32.246280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:32.246989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:32.247607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:32.247950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:32.280290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d308a8fd-aca0-4cf2-9954-56c8ddd40788 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048321 Oct 19 13:23:32.280850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 541/1007] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:33.231884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:33.234120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:33.241613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:33.242112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:33.242526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:33.243272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:33.243660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:33.244079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:33.276505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-59131cca-ade6-4283-ad2f-421faf8b46ad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048536 Oct 19 13:23:33.277055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 467/1008] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:33.292923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:33.295085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:33.301720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:33.302193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:33.302620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:33.303420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:33.303854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:33.304266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:33.334122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-836436ab-577d-4700-b167-a6ba50a79f6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Oct 19 13:23:33.335213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 542/1009] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:34.289916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:34.292672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:34.299568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:34.300045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:34.300459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:34.301193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:34.301756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:34.302053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:34.335021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c6ac69bf-8e3a-4859-bd2e-c34b72f85432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049206 Oct 19 13:23:34.335900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 468/1010] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:34.347263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:34.349379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:34.356312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:34.356791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:34.357244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:34.357959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:34.358401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:34.358837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:34.395258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4a97d81-99c0-4f91-86aa-2d75ed6b06fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051624 Oct 19 13:23:34.396054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 543/1011] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:35.347963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:35.350126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:35.356982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:35.357465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:35.357894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:35.358591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:35.359034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:35.359450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:35.390489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7a1cfae3-c88f-46ad-be06-e3c194939e66 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046654 Oct 19 13:23:35.391238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 469/1012] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:35.412009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:35.414206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:35.420815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:35.421331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:35.421767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:35.422621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:35.423106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:35.423529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:35.453692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d523fb88-8309-46c8-9b45-1183fc729e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Oct 19 13:23:35.454288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 544/1013] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:36.403806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:36.406028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:36.412665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:36.413643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:36.414075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:36.414792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:36.415238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:36.415655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:36.446086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-25d3a780-289f-4fdf-bd2b-96f7cded6739 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046194 Oct 19 13:23:36.446984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 470/1014] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:36.466735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:36.469001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:36.475863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:36.476606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:36.477081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:36.477779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:36.478231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:36.478628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:36.515840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-45f062a5-fc07-4fb6-b206-8a1dd4b201aa tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053029 Oct 19 13:23:36.516395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 545/1015] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:37.463831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:37.467375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:37.477367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:37.477838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:37.478258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:37.478943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:37.479380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:37.479790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:37.517476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aaae01ed-d780-4541-83d7-cda39364ea53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053991 Oct 19 13:23:37.517476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 471/1016] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:37.528067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:37.530251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:37.536917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:37.537423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:37.537854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:37.538588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:37.539048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:37.539468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:37.568576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c93f0ee2-d1eb-4e9b-bda4-3a80133fa039 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 19 13:23:37.569084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 546/1017] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:38.526881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:38.529220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:38.536693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:38.537301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:38.537802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:38.538636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:38.539156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:38.539640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:38.572891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-083e34c1-ed28-4d7f-8243-e2651ace13bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051600 Oct 19 13:23:38.577924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 472/1018] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:38.583119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:38.585552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:38.592656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:38.593168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:38.593603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:38.594304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:38.594788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:38.595208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:38.625498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c90aa096-1cd4-4b9a-a32d-59c58ce52a1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Oct 19 13:23:38.626216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 547/1019] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:39.590556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:39.594088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:39.604969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:39.605551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:39.605987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:39.606693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:39.607146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:39.607556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:39.639728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:39.653053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e626efca-bc49-46fc-9ea4-64f83565fbe4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057630 Oct 19 13:23:39.653053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 473/1020] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:39.653806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:39.653806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:39.653806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:39.653806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:39.654139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:39.654139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:39.654139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:39.684267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-86a8d29d-e171-4477-aff7-97ea729dfa7d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049930 Oct 19 13:23:39.684913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 548/1021] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:40.655877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:40.658306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:40.665558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:40.666060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:40.666497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:40.667177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:40.667701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:40.668255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:40.697002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:40.699150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-925b0cd5-079b-44f8-b79e-129ce95fd8b3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048049 Oct 19 13:23:40.699854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:40.704336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 474/1022] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:40.706335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:40.706798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:40.707288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:40.708089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:40.708423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:40.709017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:40.741403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d4094b5e-69c7-4dda-be42-c4ab6274f255 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048445 Oct 19 13:23:40.742152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 549/1023] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:23:41.714411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:41.717415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:41.726468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:41.727401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:41.727971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:41.729042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:41.729678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:41.730246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:41.749689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:41.754060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:41.756832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:41.764469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-456d57a8-33a3-4c76-9e7b-573b668ac8a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055473 Oct 19 13:23:41.765090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 475/1024] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:41.765983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:41.766495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:41.766935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:41.767645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:41.768094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:41.768495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:41.800061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c72a7393-1706-4f12-a92c-a6f26dd2229a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049809 Oct 19 13:23:41.800638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 550/1025] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:23:42.781058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:42.783199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:42.790034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:42.790511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:42.790928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:42.791612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:42.792052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:42.792752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:42.812631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:42.814791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:42.821973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:42.822457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:42.822912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:42.823651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:42.824099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:42.824528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:42.824638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1beeef7b-0cac-48c9-b6b0-331fb16c9793 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049829 Oct 19 13:23:42.828833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 476/1026] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:42.867354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5dcc36fb-8e19-4a73-9c8a-b98a5f0c09f3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059042 Oct 19 13:23:42.867892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 551/1027] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:43.839877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:43.842996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:43.850117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:43.850648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:43.851080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:43.851776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:43.852221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:43.852731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:43.879958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:43.882855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:43.886750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a47bb07a-bba6-4799-a105-e83aaf40063a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052502 Oct 19 13:23:43.887330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 477/1028] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:43.890600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:43.891176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:43.891538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:43.892226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:43.892953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:43.893374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:43.912035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:43.925898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6107db14-a56a-4144-a67d-1505da1a37b9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049943 Oct 19 13:23:43.926470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 552/1029] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:44.904360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:44.907832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:44.918632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:44.919542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:44.919949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:44.920651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:44.921135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:44.921836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:44.940977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:44.944297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:44.960231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:44.960415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-50c730a6-e259-4355-af83-5bcb5f76a76f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062779 Oct 19 13:23:44.960726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:44.961211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:44.961372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 478/1030] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:44.961923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:44.962376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:44.962804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:44.995520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd0397aa-885c-4695-879f-a35839f2708f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058484 Oct 19 13:23:44.996097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 553/1031] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:45.973698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:45.976099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:45.983183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:45.983651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:45.984079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:45.984743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:45.985217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:45.985629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:46.009489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:46.011649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:46.017175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-36451bf9-45a0-4702-8c62-d412879c2e5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047288 Oct 19 13:23:46.017615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 479/1032] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:46.023072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:46.023579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:46.024013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:46.024703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:46.025206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:46.025626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:46.055817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-492993a1-c09b-442d-ac2c-c13f4ef5e830 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051759 Oct 19 13:23:46.056475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 554/1033] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:47.030928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:47.033191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:47.040140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:47.040618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:47.041084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:47.041778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:47.042222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:47.042748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:47.070765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:47.072972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:47.078526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-deea3a48-9fa5-4704-b93a-18b3cd360114 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051716 Oct 19 13:23:47.079312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 480/1034] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:47.079426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:47.080098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:47.080557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:47.081293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:47.081747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:47.082172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:47.113317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af05dd6e-4280-48e9-aa3e-d47624687ac5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Oct 19 13:23:47.113896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 555/1035] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:48.094090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:48.097176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:48.106102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:48.106717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:48.107470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:48.108400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:48.109119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:48.109655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:48.126140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:48.128420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:48.134993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:48.135753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:48.136191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:48.136955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:48.137410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:48.137836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:48.145394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb035f9d-76c2-4851-a65f-a5e542a4dfb2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057013 Oct 19 13:23:48.146165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 481/1036] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:48.170936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1282442c-450a-4a9f-af9c-953e0bfa254d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049215 Oct 19 13:23:48.171671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 556/1037] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:23:49.163228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:49.166888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:49.175045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:49.175518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:49.175972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:49.176838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:49.178575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:49.178575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:49.184507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:49.187870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:49.193871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:49.194383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:49.194814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:49.195664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:49.196126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:49.196536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:49.210378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5a007c41-26ce-49b7-8d87-28a993bcb140 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053836 Oct 19 13:23:49.211202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 482/1038] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:49.228032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ab5a402-40e0-4c1c-9118-f00bdcb7a9c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Oct 19 13:23:49.228598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 557/1039] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:50.224616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:50.227021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:50.234708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:50.235166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:50.235622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:50.236324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:50.236767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:50.237221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:50.239799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:50.242004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:50.248738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:50.249140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:50.249567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:50.250260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:50.250705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:50.251118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:50.270905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c3f25f36-b8f7-448e-bcf6-d39aa8bf4d6f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051048 Oct 19 13:23:50.272031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 483/1040] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:50.288516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a25950e7-9d91-4358-aacc-2c9b06efac0d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052642 Oct 19 13:23:50.289103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 558/1041] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:51.291050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:51.291050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:51.298185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:51.298722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:51.299196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:51.299968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:51.300467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:51.300941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:51.302413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:51.304776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:51.312079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:51.312577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:51.313051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:51.313758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:51.314215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:51.314630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:51.335652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af491d66-738d-40d2-9d30-4aece1e75075 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054858 Oct 19 13:23:51.336198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 484/1042] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:51.346438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e82ebc16-53d8-44aa-aef4-ba2c9f569336 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048348 Oct 19 13:23:51.347320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 559/1043] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:52.348555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:52.350743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:52.358313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:52.358793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:52.358957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:52.359397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:52.359897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:52.360341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:52.360754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:52.361118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:52.368160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:52.368642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:52.369110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:52.369810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:52.370268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:52.370693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:52.392667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c66f682d-c783-45df-8534-673b1a25303a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047989 Oct 19 13:23:52.396265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 485/1044] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:52.402593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8acf3008-194a-4cca-8256-96edbd2d328b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047636 Oct 19 13:23:52.403778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 560/1045] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:53.408682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:53.410940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:53.415797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:53.417811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:53.418016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:53.418271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:53.418691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:53.419415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:53.419858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:53.420264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:53.424482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:53.424982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:53.425422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:53.426117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:53.426569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:53.426990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:53.452046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d43f7e61-d83f-47ce-880a-e6306803d75a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048661 Oct 19 13:23:53.452819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 486/1046] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:53.458483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a0ea993e-3797-40ae-a615-f7a4192eded0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046634 Oct 19 13:23:53.459053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 561/1047] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:54.469059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:54.472737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:54.475451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:54.478936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:54.483442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:54.483916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:54.484334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:54.485062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:54.485496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:54.486052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:54.487264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:54.487755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:54.488190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:54.488906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:54.489372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:54.489795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:54.519476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8b6e71d-167a-4087-b692-2e374f8d8c27 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057702 Oct 19 13:23:54.520237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 487/1048] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:54.523386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-99674ab7-eaf9-4c23-b452-bd86119f4e6b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054605 Oct 19 13:23:54.524107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 562/1049] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:55.533081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:55.535201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:55.535825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:55.538014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:55.541899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:55.542368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:55.542812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:55.543514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:55.543953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:55.544379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:55.544544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:55.544950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:55.545512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:55.546095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:55.546544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:55.546962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:55.576809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b241365c-8b83-49cc-890d-31dc61fa236c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Oct 19 13:23:55.577522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 563/1050] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:55.577850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-66538aec-766f-4deb-8fb2-b53fb7cbabe9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049047 Oct 19 13:23:55.578641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 488/1051] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:56.592928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:56.593499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:56.595039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:56.595584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:56.601852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:56.602291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:56.602433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:56.602751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:56.602876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:56.603172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:56.603447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:56.603853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:56.603966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:56.604295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:56.604408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:56.604702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:56.636717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-81c4c3f1-31e5-4273-9633-ed965f4dbd54 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048584 Oct 19 13:23:56.637654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 489/1052] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:56.644809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-11451b45-6ff1-4bc6-8f44-22efbf22c12d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057637 Oct 19 13:23:56.645482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 564/1053] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:57.654518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:57.658625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:57.664140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:57.667211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:57.669917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:57.670704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:57.671614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:57.672189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:57.672622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:57.673060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:57.676031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:57.676521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:57.676986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:57.677688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:57.678122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:57.678547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:57.704679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c04286d8-9066-4b5e-9efb-539145751218 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056889 Oct 19 13:23:57.709433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-132fb93e-02c8-49bf-a572-0dc1a32dd21a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052492 Oct 19 13:23:57.709958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 490/1054] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:57.710088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 565/1055] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:58.719050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:58.721252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:58.723252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:58.725440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:58.727761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=58 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:58.727965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:58.728460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:58.728952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:58.729735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:58.730203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:58.730668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:58.733910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:58.734489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:58.735117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:58.736270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:58.736398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:58.736815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:58.761447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1c528dc2-0048-453b-aa2c-88fd66fd22d0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047852 Oct 19 13:23:58.766770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 491/1056] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:23:58.771824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0a7de43d-419e-45ac-b905-3e33d310ace4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052939 Oct 19 13:23:58.772505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 566/1057] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:59.778887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:59.782450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:59.786356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:59.788087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:23:59.791809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:23:59.794930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:59.795715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:59.796422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:59.797490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:59.798413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:59.798831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:59.800601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:59.801108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:59.801537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:59.802225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:23:59.802637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:23:59.803081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:23:59.803622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:23:59.834898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59855c0d-e9de-4596-9a87-51ad798aaf01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053492 Oct 19 13:23:59.835243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-70a1d2f2-c95d-4efc-a957-8cd7acc3e39f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063148 Oct 19 13:23:59.835813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 567/1058] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:23:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:23:59.840076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 492/1059] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:23:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:00.848320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:00.848971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:00.850482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:00.850624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:00.857430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:00.857612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:00.857906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:00.858060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:00.858337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:00.858486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:00.859029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:00.859173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:00.859453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:00.859648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:00.859893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:00.860049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:00.890210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-309d01aa-e6ab-480c-8ee8-d2243046263a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Oct 19 13:24:00.895247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 568/1060] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:00.895415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7a84a995-b83d-4bff-8374-57aff5219158 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048183 Oct 19 13:24:00.897167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 493/1061] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:01.908776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:01.909740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:01.912344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:01.912804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:01.922960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:01.923469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:01.923661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:01.923890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:01.924166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:01.924582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:01.924723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:01.925052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:01.925378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:01.925519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:01.925843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:01.926261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:01.940829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:01.959041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8eb150db-6ae1-4abf-86fb-3d26174ad547 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056669 Oct 19 13:24:01.959823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 494/1062] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:01.960311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f45b014f-9ce6-47cc-9930-af8a0861582b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059497 Oct 19 13:24:01.965251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 569/1063] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:02.972982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:02.973598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:02.975113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:02.975698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:02.982139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:02.982431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:02.982598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:02.982921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:02.983062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:02.983352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:02.983696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:02.984037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:02.984152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:02.984483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:02.984602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:02.984926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:03.017792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a40496b-f954-4b2f-849b-03f6751b9d41 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048504 Oct 19 13:24:03.018120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dcab7cd0-6a04-4129-81e8-bf5237c8213a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049136 Oct 19 13:24:03.018997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 570/1065] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:03.019143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 495/1065] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:04.030813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:04.031515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:04.032990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:04.033129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:04.039940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:04.040257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:04.040418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:04.040742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:04.040921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:04.041209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:04.041570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:04.041901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:04.042043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:04.042353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:04.042510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:04.042788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:04.075545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8b5a41a7-fa6d-4f98-a49a-8283a6eec358 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048689 Oct 19 13:24:04.076024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e5415229-054f-46d0-84a0-99db54524b3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Oct 19 13:24:04.076457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 571/1066] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:04.079842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 496/1067] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:05.088224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:05.090439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:05.091972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:05.094204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:05.097748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:05.098243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:05.098681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:05.099394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:05.099853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:05.100282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:05.100793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:05.101307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:05.101732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:05.102413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:05.102863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:05.103273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:05.133702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a7e23fa-d1df-4866-abb0-1aa91996062a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049460 Oct 19 13:24:05.134548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 572/1068] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:05.134684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c9e3eb0c-d580-4f16-94b2-6efbe56abfd1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 Oct 19 13:24:05.135253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 497/1069] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:06.147514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:06.148167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:06.149690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:06.150253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:06.156456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:06.156693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:06.156958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:06.157213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:06.157409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:06.157647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:06.158085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:06.158426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:06.158648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:06.159071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:06.159178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:06.159682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:06.191798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e444ca1-12ea-4065-a22b-1777d6fcd08c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048414 Oct 19 13:24:06.191990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec2a8769-348c-4020-9658-cbd0008f9656 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048552 Oct 19 13:24:06.192581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 498/1070] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:06.197191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 573/1071] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:07.204842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:07.206289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:07.207253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:07.208856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:07.214885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:07.215416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:07.215840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:07.216023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:07.216507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:07.216632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:07.216975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:07.217083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:07.217384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:07.217675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:07.218132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:07.218552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:07.248349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb956794-2dab-43b3-80ac-330bd5cdee1f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047498 Oct 19 13:24:07.248920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 499/1072] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:07.249121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b8cb9611-b9c8-4ed4-895d-cbae25a922ca tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048297 Oct 19 13:24:07.249711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 574/1073] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:08.262787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:08.263593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:08.265118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:08.265757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:08.272317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:08.272759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:08.272924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:08.273241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:08.273383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:08.273694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:08.273937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:08.274361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:08.274478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:08.274776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:08.274878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:08.275220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:08.305822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-37e48b33-4fc2-4ccc-b30d-1ca9a33eae18 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Oct 19 13:24:08.306241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-889b888c-d884-457c-968f-5107df67a6f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047009 Oct 19 13:24:08.306389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 500/1074] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:08.306806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 575/1075] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:24:09.319698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:09.320429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:09.321991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:09.322926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:09.329383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:09.329864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:09.330180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:09.330302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:09.330704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:09.331021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:09.331180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:09.331515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:09.331934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:09.332101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:09.332556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:09.332996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:09.364890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9b019fbd-de16-4d78-bd37-78e5b75debd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049607 Oct 19 13:24:09.365860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 501/1076] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:09.368404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74e206c7-e97b-4d10-bc72-eebe23586ae7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053020 Oct 19 13:24:09.369754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 576/1077] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:10.377824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:10.380067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:10.382722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:10.384820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:10.386699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:10.387187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:10.387966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:10.388667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:10.389167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:10.389575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:10.391263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:10.391713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:10.392156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:10.392883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:10.393328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:10.393806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:10.421086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-66e7bfc6-ada4-4f8a-aec6-c0d44f091855 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047197 Oct 19 13:24:10.421963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 502/1078] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:10.423882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b04ed3c0-cbf4-4ac5-b251-2e5c65c25a1a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045798 Oct 19 13:24:10.424458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 577/1079] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:11.437862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:11.438742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:11.441136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:11.441944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:11.448030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:11.448421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:11.448550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:11.448879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:11.448991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:11.449344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:11.449609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:11.450035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:11.450135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:11.450464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:11.450561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:11.450876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:11.481989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-de112bb3-5be6-4a77-a335-cb36108305fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049709 Oct 19 13:24:11.482274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-665bd983-0d8a-4845-bef1-0ff09e1a37ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051153 Oct 19 13:24:11.482911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 503/1080] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:11.485025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 578/1081] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:24:12.494774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:12.495486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:12.496987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:12.498942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:12.504143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:12.504692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:12.505151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:12.505859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:12.505976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:12.506310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:12.506420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:12.506731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:12.506855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:12.507457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:12.507897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:12.508317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:12.542272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bce96e4c-9161-4da2-aec1-a3e507d3bb97 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051410 Oct 19 13:24:12.542547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8cfdb17-b2cf-4a26-82a2-1b9c5a361f1a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051416 Oct 19 13:24:12.542867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 579/1083] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:12.543044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 504/1083] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:13.555616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:13.556196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:13.557792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:13.557964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:13.566022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.566273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.566697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.566939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.567212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.567674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.567924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.568130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.568375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.568519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.568800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.600160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59d1c614-04e7-40ef-8764-1ba4d4030481 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Oct 19 13:24:13.600784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 580/1084] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:13.602259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-37740328-618e-4b0c-ad7d-40e6e0d1c834 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050605 Oct 19 13:24:13.602813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 505/1085] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:13.866296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:13.866707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:13.873324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.873811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.874246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.874955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:13.875412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:13.875808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:13.903250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:24:13.994160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1e40c61c-60ae-4a40-93ff-4182445858f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 204 len: 0 microversion: 2.1 time: 0.132129 Oct 19 13:24:13.994779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 581/1086] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:24:13 2022] DELETE /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:24:14.003118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:14.003842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:14.010776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.011305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.011720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.012770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.013246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.013662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.162034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:24:14.170471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2b52f15d-a5af-4d32-96c0-2d65b14a27b9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1688 microversion: 2.1 time: 0.171197 Oct 19 13:24:14.171085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 506/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:24:13 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:24:14.614301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:14.614871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:14.616783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:14.616924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:14.623559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.623821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.624056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.624171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.624482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.624602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.625237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.625345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:14.625691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.625793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:14.626125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.626231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:14.660231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6bc13271-a7a8-472d-a8df-561a64a91c81 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049825 Oct 19 13:24:14.660503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cf0d0016-3e7a-4fa7-b21f-824b6254d58c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050686 Oct 19 13:24:14.664921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 582/1088] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:14.665395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 507/1089] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:15.194378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:15.195324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:15.202021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.203725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.204508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.205133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.205590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.206014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.316696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:24:15.324697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ca91880a-e2ee-42af-a4a4-9c8eb0f5aa6c tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 200 len: 1621 microversion: 2.1 time: 0.134388 Oct 19 13:24:15.325305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 583/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:24:15 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 1621 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:24:15.633057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7b5fee-33a8-490d-bd69-f6459c7bc0de", "name": "network-vif-deleted", "tag": "d6575047-ad79-4da2-835f-15fabf3e0f0e"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:24:15.644951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.645876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.646562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.662916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] Creating event network-vif-deleted:d6575047-ad79-4da2-835f-15fabf3e0f0e for instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de on hv-cinder-maste Oct 19 13:24:15.667547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR oslo.messaging._drivers.impl_rabbit [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] [d3a80fca-bd0b-4b8f-b42a-189766d67057] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:24:15.673838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:15.677449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:15.686098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.686665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.687002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.687719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.688168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.688802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.699047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:15.733644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-29689416-77d3-486e-a937-412c0a61f45a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065515 Oct 19 13:24:15.734715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 584/1091] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:24:15.739918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:15.742425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:15.749237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.749731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.750173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.750893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:15.751534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:15.752324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:15.787590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-950799a7-812f-4afb-b0fd-b8e49c1ea15f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 Oct 19 13:24:15.788052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 585/1092] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:16.348345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:16.349083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: bc7b5fee-33a8-490d-bd69-f6459c7bc0de] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:16.355585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.356079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.356523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.357531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.357988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.358406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.374269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] HTTP exception thrown: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Request method failure captured: Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de HTTP/1.1 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_grUiWfjHcKRjENAP_RctiCr9kbAUsDzM_Qr_3wt-wOkw5_G71-z-4onc2teEAMBslvdhpHV4pXJTdRP6ZfWkj3xOqYQIV5LYc-J_Pv1yYr7cjxwKc02k2GAIi9BSd6eLY20KJY6b-PWU3AQrVZKHF1s2-Xrfh9GnfzBWkko6dYeoM Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:24:16.375994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3df7886f27d4ef48cb9031e75a15e46", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: f71530099a11440b9d69f550286d9614 Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. Oct 19 13:24:16.377517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'bc7b5fee-33a8-490d-bd69-f6459c7bc0de'} Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:24:16.378633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. Oct 19 13:24:16.379932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:24:16.383085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Returning 404 to user: Instance bc7b5fee-33a8-490d-bd69-f6459c7bc0de could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:24:16.383085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c976d11-080c-4110-8baa-381f86497813 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de" status: 404 len: 111 microversion: 2.1 time: 0.033766 Oct 19 13:24:16.383085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 586/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:24:16 2022] GET /compute/v2.1/servers/bc7b5fee-33a8-490d-bd69-f6459c7bc0de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:24:16.389369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ddeeabfe-b7b9-4610-bc92-6d94e0d41bda tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '.version_select at 0x7ff4f912dca0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:16.417016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ddeeabfe-b7b9-4610-bc92-6d94e0d41bda tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952309576" status: 202 len: 0 microversion: 2.1 time: 0.031931 Oct 19 13:24:16.417620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 587/1094] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Oct 19 13:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952309576 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:24:16.676742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] [d3a80fca-bd0b-4b8f-b42a-189766d67057] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 55002. Oct 19 13:24:16.681693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-6816d59c-f989-43d8-91a7-c63ab530a72a req-58137829-f406-458c-bb3a-94002f9ff160 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.170412 Oct 19 13:24:16.683206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 508/1095] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:16.750046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:16.754566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:16.766793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.767305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.767748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.768672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.769749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.770259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.802051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:16.804490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:16.812276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.814659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.816162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.818790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:16.819735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:16.820245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c8a13ed9-4feb-4a4c-825e-ea18d42bda7b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077515 Oct 19 13:24:16.820623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:16.821618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 588/1096] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:16.845620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:16.873276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd3d307c-36cf-499a-8660-5647b6737444 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076345 Oct 19 13:24:16.874210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 509/1097] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:17.834890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:17.837074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:17.844013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:17.844501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:17.844991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:17.845697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:17.846150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:17.846579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:17.877018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39468461-d031-4453-8429-b59a254b25db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047083 Oct 19 13:24:17.877564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 589/1098] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:17.886312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:17.888826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:17.896243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:17.896711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:17.897165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:17.897841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:17.898283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:17.898697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:17.932384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2c16d591-ca47-4be6-b1a0-bf09fc4f055d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050020 Oct 19 13:24:17.932994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 510/1099] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:18.890016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:18.892189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:18.899150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:18.899631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:18.900263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:18.900964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:18.901408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:18.901826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:18.933592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-33667001-f0f2-43cb-9934-bccdaf95e3cf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047951 Oct 19 13:24:18.934371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 590/1100] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:18.944732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:18.946904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:18.953942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:18.954443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:18.954848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:18.955541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:18.955989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:18.956575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:18.988595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dde7a672-d10b-420d-8409-8040b3ccaa0c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047754 Oct 19 13:24:18.989115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 511/1101] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:19.947235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:19.949424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:19.956100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:19.956774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:19.957278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:19.957984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:19.958437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:19.958857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:19.990596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9b61eaa-3e76-48f6-bb9d-b9eb75ebc923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047366 Oct 19 13:24:19.991154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 591/1102] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:20.001031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:20.003357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:20.010461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:20.010939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:20.011370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:20.012060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:20.012894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:20.013318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:20.044392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-46a8d203-36ee-4c7b-95c0-92a012bc14f0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Oct 19 13:24:20.044999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 512/1103] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:21.003540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:21.005621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:21.012899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:21.013381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:21.013814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:21.014512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:21.014971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:21.015391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:21.046271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9ed534f-16a8-44a2-ba74-024864c46876 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046992 Oct 19 13:24:21.046841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 592/1104] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:21.057369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:21.059513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:21.066302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:21.066775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:21.067195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:21.067977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:21.068426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:21.068834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:21.100098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-043777a9-d405-4ff9-80d1-2785cd480280 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046796 Oct 19 13:24:21.100642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 513/1105] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:22.059547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:22.061736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:22.069024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:22.069497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:22.069943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:22.070646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:22.071102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:22.071514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:22.103276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-895fde59-973b-485a-a77d-de267cae47f7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047672 Oct 19 13:24:22.103848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 593/1106] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:22.113160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:22.115358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:22.122213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:22.122697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:22.123129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:22.123852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:22.124284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:22.124710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:22.156395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-26aacf7b-d4d2-436d-af65-9c3d266ce153 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047315 Oct 19 13:24:22.157148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 514/1107] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:23.116631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:23.118795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:23.125966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:23.126446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:23.126888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:23.127583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:23.128284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:23.128733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:23.159392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c4a5641-c060-4bac-908b-bd5ef5997cf6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046619 Oct 19 13:24:23.160123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 594/1108] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:23.169333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:23.171521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:23.178748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:23.179221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:23.179644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:23.180330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:23.180770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:23.181212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:23.211516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c26ee33b-b14f-4e21-9a05-b6a65104543f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Oct 19 13:24:23.212098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 515/1109] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:24.172583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:24.175112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:24.181796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:24.182284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:24.182717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:24.183418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:24.183872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:24.184295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:24.215914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9d7f61dc-62f0-4249-bf52-c8a3586453df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047391 Oct 19 13:24:24.216450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 595/1110] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:24.225037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:24.227310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:24.234288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:24.234779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:24.235208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:24.235896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:24.236347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:24.236766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:24.269301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-15827eba-e387-43fe-9162-bf2d238405c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048953 Oct 19 13:24:24.269870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 516/1111] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:25.230863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:25.233074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:25.240098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:25.240619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:25.241098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:25.241812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:25.242264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:25.242688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:25.276647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d1d0fdfe-33ff-47a4-98ce-c12ab99adbb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049822 Oct 19 13:24:25.277281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 596/1112] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:25.282047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:25.284549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:25.291320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:25.291801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:25.292254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:25.293010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:25.293456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:25.293871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:25.337809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b22d4e41-f274-46c7-848b-f897123139f8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059640 Oct 19 13:24:25.338380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 517/1113] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:24:26.290078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:26.292167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:26.299649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:26.300400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:26.300664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:26.301418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:26.301870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:26.302300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:26.333808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f9b404d-0c05-48dd-bd86-f530505c86db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047879 Oct 19 13:24:26.334390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 597/1114] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:26.351286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:26.353490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:26.360427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:26.360892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:26.361361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:26.362064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:26.363087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:26.363512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:26.395312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d3ed26b1-702f-47b0-8210-c1c252437b1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048873 Oct 19 13:24:26.395872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 518/1115] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:27.347120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:27.349344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:27.356377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:27.356976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:27.357420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:27.358095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:27.358540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:27.358956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:27.391440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5a1cad14-fe7f-48a8-9124-df4797cdab1e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048570 Oct 19 13:24:27.392018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 598/1116] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:27.407951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:27.410144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:27.417188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:27.417673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:27.418105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:27.418803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:27.419252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:27.419670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:27.450244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-157e9874-f14a-4b5c-ba28-6662436c1965 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Oct 19 13:24:27.450815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 519/1117] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:28.463371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:28.465633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:28.473509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:28.474002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:28.474435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:28.475154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:28.475603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:28.476019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:28.490290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:28.493005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:28.499606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:28.500101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:28.500540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:28.501317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:28.501772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:28.502196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:28.510512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-80a21d26-f47a-439f-b56f-2b3426340488 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051177 Oct 19 13:24:28.511088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 520/1118] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:28.535089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c151b5fc-a78c-42ef-904b-be88f435fb04 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133995 Oct 19 13:24:28.535697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 599/1119] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:29.524318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:29.526519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:29.534251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:29.534724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:29.535158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:29.535878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:29.536326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:29.536745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:29.548008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:29.550549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:29.553008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:29.559837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:29.560544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:29.561137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:29.561886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:29.562359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:29.562782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:29.580533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-10dbdb79-d27c-4523-a3de-7eb9e712c310 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060302 Oct 19 13:24:29.581403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 521/1120] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:29.606480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4a66364b-f3fc-4881-991e-b049ef781a36 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062402 Oct 19 13:24:29.607095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 600/1121] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:30.595328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:30.598377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:30.601001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=60 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:30.608308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:30.608898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:30.609413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:30.610157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:30.610683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:30.611217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:30.620122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:30.622367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:30.629993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:30.630479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:30.630977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:30.631733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:30.632175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:30.632599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:30.647112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-36f84b9a-276c-4cf0-b259-701ba594ac10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055915 Oct 19 13:24:30.647704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 522/1122] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:30.667500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c1dd8ce8-c1c0-43fb-b1eb-d4439a58f3c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051521 Oct 19 13:24:30.668093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 601/1123] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:24:31.660562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:31.662922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:31.670584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:31.671077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:31.671526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:31.672247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:31.672703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:31.673156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:31.681847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:31.684329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:31.692801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:31.693308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:31.693728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:31.694511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:31.695132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:31.695657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:31.709990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dbfb0d5c-33ca-4488-9fbc-49dcf65f94fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053579 Oct 19 13:24:31.710583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 523/1124] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:31.720449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:31.735570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0288c626-87a4-422c-9cba-ae3c460825a8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059152 Oct 19 13:24:31.736360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 602/1125] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:24:32.724171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:32.726641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:32.734415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:32.735084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:32.735521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:32.736236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:32.736752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:32.737296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:32.757550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:32.759690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:32.766754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:32.767413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:32.767855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:32.768894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:32.769563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:32.770022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:32.772075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86b8997a-73c1-43a2-a9a8-85ab52a5a62c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Oct 19 13:24:32.772651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 524/1126] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:32.803312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51028dec-a491-4e32-a5f2-51ce81d5d9ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050487 Oct 19 13:24:32.803893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 603/1127] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:33.785184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:33.787330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:33.794166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:33.794650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:33.795081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:33.795778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:33.796227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:33.796646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:33.816591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:33.818761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:33.825878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:33.826377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:33.826808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:33.827507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:33.827957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:33.828365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:33.828735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f5af44fa-c7d9-4c8e-8ade-0fb132a53c3d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Oct 19 13:24:33.829375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 525/1128] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:33.860101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cfc1329d-7b64-41a4-9877-b976a686afb3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047893 Oct 19 13:24:33.860688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 604/1129] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:34.842032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:34.844199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:34.852290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:34.852774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:34.853239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:34.853959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:34.854408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:34.854809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:34.858900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:34.872257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:34.874416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:34.881232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:34.881719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:34.882146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:34.882840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:34.883291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:34.883709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:34.887678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-83054904-fdb8-4492-91eb-8042633193c2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049334 Oct 19 13:24:34.888260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 526/1130] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:34.917064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7bdfffe3-e60f-4dde-bb53-3761fd7cda93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048853 Oct 19 13:24:34.917795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 605/1131] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:35.900465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:35.902633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:35.909762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:35.910234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:35.910655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:35.911348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:35.911785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:35.912194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:35.930053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:35.932932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:35.940149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:35.940892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:35.941688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:35.942671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:35.943137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:35.943571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:35.944030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-587e6882-0af2-4dab-8d11-7a326d02a4fe tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047571 Oct 19 13:24:35.944609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 527/1132] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:35.976979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bb394ef7-53b1-499b-8c9a-7258567446a0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051003 Oct 19 13:24:35.977557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 606/1133] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:36.958370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:36.960385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:36.966767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:36.967231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:36.967649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:36.968337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:36.968778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:36.969217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:36.990566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:36.993194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:37.000902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:37.001409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:37.001875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:37.002406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a08fa9d7-486f-4e5d-88df-80b992b6ab04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Oct 19 13:24:37.002655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:37.003292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 528/1134] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:37.003812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:37.004232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:37.038221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-64aa6229-0f43-4691-8766-c08c63e1135a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052019 Oct 19 13:24:37.038819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 607/1135] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:38.015971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:38.018168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:38.025071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:38.025542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:38.025964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:38.026656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:38.027091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:38.027528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:38.051751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:38.053944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:38.059162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-540d175b-f2d0-48bf-ba5f-67f4e4cb7e67 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047496 Oct 19 13:24:38.059727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 529/1136] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:38.060509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:38.061017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:38.061447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:38.062142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:38.062585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:38.062996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:38.259290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-57c0428b-5e5e-4b88-922f-2f99eaf4aac3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.212126 Oct 19 13:24:38.259735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 608/1137] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:39.073123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:39.075346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:39.082527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:39.083016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:39.083434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:39.084125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:39.084571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:39.084987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:39.117890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3837d59e-2358-4292-a3a1-aee6c65ddce3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049375 Oct 19 13:24:39.118510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 530/1138] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:39.272997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:39.275118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:39.281651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:39.282120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:39.282541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:39.283222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:39.283701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:39.284358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:39.318245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74869f5c-b2fe-4eae-85a8-c8d44475c654 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Oct 19 13:24:39.318812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 609/1139] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:40.131171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:40.133301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:40.140726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:40.141224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:40.141649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:40.142348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:40.142781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:40.143257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:40.174023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3c4c380b-8180-405d-a9e5-57cda0c83dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Oct 19 13:24:40.174878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 531/1140] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:40.332655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:40.335183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:40.342631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:40.343117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:40.343541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:40.344239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:40.344679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:40.345120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:40.378305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-871df565-fdb2-4990-a02a-f19f3788d9cb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050349 Oct 19 13:24:40.379285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 610/1141] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:41.188299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:41.190449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:41.198511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:41.199045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:41.199543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:41.200266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:41.200708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:41.201167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:41.233798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1f59168a-e994-485e-9f66-6c3a0dbea138 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Oct 19 13:24:41.234385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 532/1142] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:41.392367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:41.394582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:41.401246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:41.401724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:41.402149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:41.402836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:41.403274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:41.403684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:41.433882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-53e18cd7-c0cc-40dc-8bf3-800eaab5e274 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045518 Oct 19 13:24:41.434438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 611/1143] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:42.247464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:42.249600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:42.257814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:42.258308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:42.258727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:42.259614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:42.260097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:42.260515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:42.293118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-08d9dd65-fa92-41ef-a86c-1d93e7992b50 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049678 Oct 19 13:24:42.293704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 533/1144] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:42.446917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:42.449182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:42.456753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:42.457276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:42.457714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:42.458431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:42.458878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:42.459301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:42.497186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a8cb7aaf-f4a3-457c-9334-6dfdf37bf05c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054184 Oct 19 13:24:42.497828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 612/1145] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:43.306978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:43.310216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:43.321753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:43.322559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:43.323301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:43.324240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:43.325063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:43.325794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:43.364145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8606576d-617d-437e-bb27-25955a612fb9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062001 Oct 19 13:24:43.364736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 534/1146] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:43.510923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:43.513568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:43.521066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:43.521570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:43.522006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:43.522709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:43.523156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:43.523579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:43.557533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-688a92fa-0217-483b-9a92-43d22c23817b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050822 Oct 19 13:24:43.558003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 613/1147] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:44.377395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:44.379583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:44.387025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:44.387490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:44.388057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:44.388746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:44.389246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:44.389656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:44.421549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad9698f5-2da9-4a12-ab2a-a45fb58e46df tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048085 Oct 19 13:24:44.422129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 535/1148] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:44.571023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:44.573138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:44.580317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:44.580808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:44.581248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:44.581977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:44.582418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:44.582833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:44.619225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9a24360-55ff-46ef-a805-89b36bbc6cbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052325 Oct 19 13:24:44.619781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 614/1149] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:45.436827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:45.439855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:45.450090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:45.450665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:45.451116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:45.451841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:45.452275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:45.452687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:45.486940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d77958d5-7555-4103-96eb-18da2fcebd91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055754 Oct 19 13:24:45.487629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 536/1150] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:45.633316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:45.637206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:45.647570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:45.648337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:45.649041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:45.650140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:45.650790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:45.651393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:45.686603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-35abda81-b702-41cd-8292-6476ce399993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058235 Oct 19 13:24:45.687203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 615/1151] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:46.500283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:46.502492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:46.510601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:46.511088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:46.511516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:46.512567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:46.513056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:46.513476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:46.547417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-becf872b-7a3e-4f78-a53c-52db790b5ff2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051192 Oct 19 13:24:46.548052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 537/1152] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:46.700174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:46.702392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:46.710123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:46.710615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:46.711082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:46.711812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:46.712256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:46.712678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:46.744390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1e4393b4-ba91-4b32-b106-b4a8fd45b37e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048178 Oct 19 13:24:46.744987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 616/1153] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:47.560521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:47.562686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:47.570453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:47.570936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:47.571362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:47.572089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:47.572527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:47.573008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:47.758209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:47.760473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:47.765351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c435d854-c891-48bf-831d-3db07b605e93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209041 Oct 19 13:24:47.765925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 538/1154] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:47.767672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:47.768156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:47.768615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:47.769322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:47.769767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:47.770182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:47.799775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2978b41c-d03c-41c9-8c64-9abcf4fa197f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045540 Oct 19 13:24:47.800315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 617/1155] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:48.778734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:48.780922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:48.788006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:48.788492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:48.789039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:48.789726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:48.790166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:48.790577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:48.815372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:48.817707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:48.824387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:48.824981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:48.825601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:48.826313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:48.826763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:48.827657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:48.832765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ce13508b-d14c-42ee-b782-82fde682cf04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059021 Oct 19 13:24:48.837109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 539/1156] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:48.858075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6db02fa7-406c-4f9f-bda0-fd5c63688f92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049790 Oct 19 13:24:48.858671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 618/1157] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:49.846219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:49.848581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:49.854896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:49.856370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:49.856370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:49.856594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:49.856995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:49.857417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:49.871217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:49.874198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:49.881180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:49.881936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:49.882365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:49.883066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:49.883491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:49.883927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:49.888461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:49.889828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-378a5d39-7dc5-47fc-b24b-1052246cbea3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048167 Oct 19 13:24:49.890511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 540/1158] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:49.917090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b07d0541-16a0-4233-b7ae-4c625ac4fdd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049053 Oct 19 13:24:49.917090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 619/1159] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:24:50.908643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:50.912181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:50.921611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:50.922096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:50.922524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:50.923210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:50.923651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:50.924213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:50.930277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:50.932707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:50.939078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:50.939649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:50.940467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:50.941119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:50.941551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:50.942151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:50.956545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-efe58f18-d774-43df-9e2f-04f4b9cf7e1c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055629 Oct 19 13:24:50.957067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 541/1160] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:50.974977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59cd8842-ae7b-4a66-84a9-84d69d6a14ac tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048543 Oct 19 13:24:50.975560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 620/1161] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Oct 19 13:24:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:24:51.972337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:51.974633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:51.981631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:51.982110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:51.982536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:51.983351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:51.983800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:51.984342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:51.991586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:24:51.995415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:52.004960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:52.005808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:52.007085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:52.007436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:52.008418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:52.008967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:52.018793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:24:52.026044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e4c9a4c3-4e30-490f-82be-c21f214e7e7f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057706 Oct 19 13:24:52.027487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 542/1162] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:24:52.097358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aff5f858-7917-406f-a4e2-cf370158a95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action" status: 200 len: 38061 microversion: 2.20 time: 0.112331 Oct 19 13:24:52.098320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 621/1163] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Oct 19 13:24:51 2022] POST /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621/action => generated 38061 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:24:53.040776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:53.043168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:53.050753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:53.051210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:53.051639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:53.052365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:53.052836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:53.053272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:53.085600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2ed2681b-8fcc-4085-83ad-71a111c762f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Oct 19 13:24:53.085908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 543/1164] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:54.099401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:54.101735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:54.109694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:54.110176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:54.110633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:54.111378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:54.112141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:54.112564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:54.146841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4e1ed747-7a96-405f-bfed-c388bb2f91fd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051963 Oct 19 13:24:54.147424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 622/1165] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:55.159917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:55.162071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:55.169003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:55.169871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:55.170480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:55.171623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:55.172250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:55.173014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:55.207943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e58a8f1-0fce-4270-87e3-b28e40c1871f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052171 Oct 19 13:24:55.208491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 544/1166] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:56.222329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:56.225170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:56.234445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:56.235054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:56.235559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:56.236430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:56.237462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:56.237462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:56.276986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0624cb00-ad30-48f0-b15a-0bbf0ec68be7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059019 Oct 19 13:24:56.277648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 623/1167] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:57.293815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:57.296182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:57.307986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:57.308822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:57.309631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:57.310852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:57.311645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:57.312379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:57.368640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d442cccf-9c83-419a-abe7-abb3f4897168 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079153 Oct 19 13:24:57.369672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 545/1168] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:58.384257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:58.386863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:58.394087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:58.394570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:58.394998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:58.395691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:58.396132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:58.396545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:58.433923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b1a1f74-31ff-45b3-b32d-d931761f08e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053411 Oct 19 13:24:58.434920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 624/1169] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:24:59.451390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:24:59.455247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:24:59.467410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:59.468030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:59.468660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:59.469514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:24:59.470028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:24:59.470717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:24:59.505453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c83d422-d8c9-4c42-979d-2511d9193511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060627 Oct 19 13:24:59.506037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 546/1170] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:24:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:00.522124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:00.525889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:00.530111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=50 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:00.541711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:00.542563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:00.543323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:00.544565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:00.545419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:00.546177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:00.584671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4bdb15e8-23f1-4786-98e7-2164e3132eb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069765 Oct 19 13:25:00.585176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 625/1171] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:01.597782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:01.599985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:01.602716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=50 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:01.609288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:01.609912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:01.610449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:01.611389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:01.612177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:01.612779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:01.649850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cbd11194-f008-4e4c-b5fe-930beac7cbd8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056161 Oct 19 13:25:01.650427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 547/1172] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:02.671358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:02.675288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:02.687423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:02.688250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:02.689011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:02.690282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:02.691087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:02.691783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:02.741491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-96012151-340f-425b-b745-a38599402707 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077194 Oct 19 13:25:02.742138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 626/1173] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:03.757899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:03.760357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:03.768548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:03.769155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:03.769623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:03.770363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:03.770844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:03.771295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:03.805255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fcc00512-f085-4c3f-a634-dd6800c97045 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052997 Oct 19 13:25:03.805917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 548/1174] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:04.818614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:04.821164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:04.828814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:04.829470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:04.830052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:04.831100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:04.831608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:04.832079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:04.869999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e70fe542-939c-4a3d-90ec-0116368d358e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055228 Oct 19 13:25:04.871003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 627/1175] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:05.892397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:05.896079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:05.907568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:05.908435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:05.909238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:05.910480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:05.911255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:05.911994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:05.962245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-329b429a-7fb1-4cd9-bd31-f22b0384c480 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078025 Oct 19 13:25:05.962824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 549/1176] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:06.980791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:06.984232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:06.995325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:06.996165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:06.996931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:06.998131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:06.998908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:06.999635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:07.051077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f2714c3-c78b-4703-afcd-b96eeda1b077 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077885 Oct 19 13:25:07.051986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 628/1177] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:08.067796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:08.070102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:08.077404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:08.077954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:08.078428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:08.079225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:08.079765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:08.080423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:08.117571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7996e847-5de2-4c31-8718-193a5a6df90f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054142 Oct 19 13:25:08.118657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 550/1178] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:09.132360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:09.134617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:09.142390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:09.142885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:09.143316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:09.144021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:09.144464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:09.144897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:09.177284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c8537c1a-8187-4ed9-b90f-6f984ed99416 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049869 Oct 19 13:25:09.177972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 629/1179] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:10.194733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:10.196805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:10.204060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:10.204539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:10.205039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:10.205765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:10.206186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:10.206598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:10.238849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9377bf4f-a51d-4dc7-a847-fd1aa09ec563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051434 Oct 19 13:25:10.239433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 551/1180] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:11.255583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:11.258307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:11.266573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:11.267095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:11.267795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:11.268628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:11.269495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:11.270121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:11.312451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-70a3aa72-8574-42ec-95ab-2c30e1bff334 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064346 Oct 19 13:25:11.313787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 630/1181] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:12.328622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:12.331392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:12.338332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:12.338916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:12.339475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:12.340223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:12.340811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:12.341308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:12.377070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e003de7-05fd-4067-95c0-72af84a27797 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051978 Oct 19 13:25:12.377965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 552/1182] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:13.399251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:13.403180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:13.415464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:13.416323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:13.417122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:13.418351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:13.419149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:13.419887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:13.471194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b6f67435-fdce-44ab-9400-44dc0eee3bfb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080071 Oct 19 13:25:13.472235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 631/1183] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:13.937519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:13.940149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:13.951928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:13.952761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:13.953537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:13.955130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:13.956255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:13.957100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:14.014035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2925fe01-a1f0-4f76-8aae-f4a301d0b362 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081394 Oct 19 13:25:14.015022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 553/1184] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:14.488081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:14.490434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:14.497296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:14.497778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:14.498212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:14.498909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:14.499353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:14.499767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:14.538936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9b74b738-efda-4adf-9f7f-7714458aa2c8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055149 Oct 19 13:25:14.539691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 632/1185] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:15.034318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:15.038162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:15.048544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:15.049343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:15.049782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:15.050604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:15.051226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:15.051835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:15.093622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-474a6ad4-fac1-4efd-ac6f-fd56b2fa5b6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066589 Oct 19 13:25:15.094171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 554/1186] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:15.552942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:15.555584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:15.562835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:15.563440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:15.564189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:15.565134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:15.565686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:15.566197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:15.606353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2fc9cd6e-7e97-407c-b4c0-2f37cd4ac26c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057324 Oct 19 13:25:15.607267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 633/1187] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:16.111129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:16.113963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:16.121661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:16.122347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:16.122909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:16.123744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:16.124281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:16.124789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:16.161010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6398ffcd-5698-421e-a603-4cbc897ade28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056546 Oct 19 13:25:16.161983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 555/1188] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:16.623242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:16.626048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:16.638269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:16.639079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:16.639849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:16.641294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:16.642178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:16.642961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:16.683516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb2bba5a-fda4-4508-82a1-0c65df9efde7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064407 Oct 19 13:25:16.684101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 634/1189] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:17.177160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:17.179976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:17.188123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:17.189147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:17.190386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:17.191274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:17.192216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:17.193198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:17.240942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c51e6450-0043-4ed8-af64-38be35e9fda8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068808 Oct 19 13:25:17.241578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 556/1190] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:17.700278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:17.703951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:17.713525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:17.714024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:17.714478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:17.715208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:17.715665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:17.716087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:17.765440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bfe39859-e519-4292-ad32-7a3549186c10 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071314 Oct 19 13:25:17.766406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 635/1191] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:18.259562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:18.263575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:18.276024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.276770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.277471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:18.278604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.279352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.281933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:18.336651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af1cf083-aab5-4973-ac30-833159fddf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082844 Oct 19 13:25:18.337350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 557/1192] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:18.781898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:25:18.784159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:18.791017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.791498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.791944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:18.792636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.793127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.793554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:18.797494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:18.876179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6da1c069-7f9b-4880-bb35-77722721ee9c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action" status: 200 len: 82953 microversion: 2.1 time: 0.098017 Oct 19 13:25:18.877328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 636/1193] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:25:18 2022] POST /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/action => generated 82953 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:25:18.894739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:18.895271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:18.901415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.901896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.902322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:18.903007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:18.903447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:18.903860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:19.085038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lazy-loading 'services' on Instance uuid e1de460a-d49c-4426-b831-aea60f28e9aa {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:25:19.155903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Request method failure captured: Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments/d4ad7386-201d-41f1-a108-11867637f00d HTTP/1.1 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_iF6tMniCQUNjwhpfLBpEmCXB3tO-OslefpRKs8b8WzK6t0-WQttJxKLdNSs8_mdzEkTFSaJYc466wJOL5Zc7T9u2zbmlW-dxfVOqlwNJu3zErI9Bq_-ZEaNx1NhOfbkNQmzMEL9lRviKhbedgjOnQGGs84_OpX4Afz-qDsigJ11BU Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: f16aafb1b5ea4b0b911c62d0acadbc47 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestMinimumBasicScenario-10071495 Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:25:19.160437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f16aafb1b5ea4b0b911c62d0acadbc47", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16aafb1b5ea4b0b911c62d0acadbc47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f16aafb1b5ea4b0b911c62d0acadbc47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f16aafb1b5ea4b0b911c62d0acadbc47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestMinimumBasicScenario-10071495 Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: f16aafb1b5ea4b0b911c62d0acadbc47 Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestMinimumBasicScenario-10071495 Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestMinimumBasicScenario-10071495-project Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: a3b0b74c4c894c4d84c3a014a33a786d Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestMinimumBasicScenario-10071495-project Oct 19 13:25:19.162148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'server_id': 'e1de460a-d49c-4426-b831-aea60f28e9aa', 'id': 'd4ad7386-201d-41f1-a108-11867637f00d'} Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 13:25:19.163098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:25:19.165012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:25:19.166588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:25:19.168020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) Oct 19 13:25:19.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:25:19.170888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cec88c1d-af79-4d9e-bcd7-74d9f63a2603) {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:25:19.170888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-26c6e584-fafa-41a3-84f8-398225fc0287 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments/d4ad7386-201d-41f1-a108-11867637f00d" status: 400 len: 269 microversion: 2.1 time: 0.274001 Oct 19 13:25:19.170888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 558/1194] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:25:18 2022] DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa/os-volume_attachments/d4ad7386-201d-41f1-a108-11867637f00d => generated 269 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:25:19.353733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:19.356160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:19.363997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:19.364454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:19.364896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:19.365772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:19.366222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:19.366640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:19.401330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2969dd06-f90b-4d69-9e04-ac483f49d9e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052267 Oct 19 13:25:19.401896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 637/1195] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:20.418761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:20.422121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:20.431642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:20.432122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:20.432761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:20.433682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:20.434141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:20.434565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:20.438893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:20.467990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-96031ed5-1b1c-415e-b419-5a89ca99c77c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056884 Oct 19 13:25:20.468574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 559/1196] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:21.484461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:21.487612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:21.494558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:21.495046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:21.495479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:21.496333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:21.496638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:21.497091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:21.535038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1559ebff-d8be-4c22-834f-7cc7c1933bce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057715 Oct 19 13:25:21.535618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 638/1197] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:22.552465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:22.556192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:22.565575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:22.566493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:22.566832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:22.568094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:22.568885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:22.569536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:22.626333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1a457a0d-4d96-483b-b746-c966e27b0541 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080867 Oct 19 13:25:22.627952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 560/1198] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:23.640062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:23.642449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:23.649887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:23.650371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:23.650809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:23.651511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:23.651965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:23.652391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:23.705437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-17e68b79-b673-401e-a6e4-598dae4d8e2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069480 Oct 19 13:25:23.706187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 639/1199] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:24.719983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:24.722775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:24.729707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:24.730175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:24.730598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:24.731296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:24.731745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:24.732158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:24.764448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab0216b5-4e30-4242-9977-6233febdc1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049053 Oct 19 13:25:24.765045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 561/1200] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:25.778180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:25.780423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:25.788297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:25.788918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:25.789632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:25.790557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:25.791304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:25.791931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:25.844682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b37b24ff-8142-4cb4-92c1-78aef7b0fbef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070552 Oct 19 13:25:25.845649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 640/1201] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:26.864884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:26.868330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:26.879597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:26.879987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:26.880411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:26.881177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:26.881626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:26.882036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:26.929286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d99f180a-818c-4f70-b685-4936d7c65d4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072360 Oct 19 13:25:26.929855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 562/1202] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:27.945158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:27.952952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:27.961615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:27.962429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:27.963139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:27.964109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:27.964572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:27.965028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:28.011193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-706608fb-fd22-47ff-a2f0-f164de62b097 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072084 Oct 19 13:25:28.011808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 641/1203] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:29.024308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:29.026518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:29.034421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:29.035103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:29.035103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:29.036954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:29.036954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:29.037453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:29.073043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0df630e4-d829-4301-a797-3de4a5d382b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052620 Oct 19 13:25:29.074016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 563/1204] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:30.091371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:30.093601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:30.101053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:30.101538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:30.101968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:30.102685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:30.103252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:30.103675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:30.146519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1c719e39-9f9a-437b-adcd-d0da28c80d8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059175 Oct 19 13:25:30.152100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 642/1205] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:31.163523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:31.169269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:31.185708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:31.187068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:31.188030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:31.189791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:31.191015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:31.192430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:31.241407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-466d8279-7485-49df-9f79-fac112637a6d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085164 Oct 19 13:25:31.242193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 564/1206] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:32.269984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:32.272340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:32.274986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=36 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:32.285568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:32.286072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:32.286506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:32.287353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:32.287681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:32.288099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:32.327605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1cb6b2cc-411e-45f8-b6d9-98c73ad86dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075169 Oct 19 13:25:32.328305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 643/1207] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:33.344209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:33.347661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:33.351364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=36 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:33.358492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:33.359140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:33.359816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:33.360898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:33.361530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:33.362215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:33.404987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6edb130f-de16-4f4d-b694-7f590a640587 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065356 Oct 19 13:25:33.404987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 565/1208] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:34.417548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:34.419789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:34.426798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:34.427293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:34.427749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:34.428449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:34.429001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:34.429430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:34.462793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb13faa6-2fa7-40db-9217-4053fdf3935a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050367 Oct 19 13:25:34.463608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 644/1209] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:35.479611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:35.487188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:35.502482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:35.503225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:35.503992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:35.505324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:35.506559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:35.507387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:35.562570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7fb86e43-60c6-406d-9690-212e8d9adfbf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089999 Oct 19 13:25:35.563293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 566/1210] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:36.578609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:36.581353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:36.588350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:36.588846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:36.589314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:36.590016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:36.590468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:36.590886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:36.634053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d193034b-d169-4349-adae-2cfc4d158819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059896 Oct 19 13:25:36.634719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 645/1211] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:37.648706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:37.651324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:37.663944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:37.663944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:37.663944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:37.663944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:37.664664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:37.664664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:37.693679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-671a744f-d208-4f02-ad21-10d2b854723e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049232 Oct 19 13:25:37.694244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 567/1212] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:38.708248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:38.712331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:38.728070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:38.729033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:38.729888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:38.731276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:38.732134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:38.732951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:38.774693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d6c98fe8-ac00-43f3-b810-caba5ae2495a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072596 Oct 19 13:25:38.775307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 646/1213] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:39.789271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:39.791691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:39.799589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:39.800077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:39.800692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:39.801617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:39.802691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:39.803360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:39.842812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e5925e78-16d8-4c42-9404-a0ce5fb89606 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058028 Oct 19 13:25:39.843393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 568/1214] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:40.855918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:40.858134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:40.865763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:40.866244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:40.866671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:40.867367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:40.867809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:40.868219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:40.916559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-76f9c5fa-4c23-4084-84ea-f7ad914fc94f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064235 Oct 19 13:25:40.917581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 647/1215] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:41.932623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:41.935363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:41.944265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:41.944755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:41.945193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:41.945959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:41.945959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:41.947073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:41.993319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-08703ac4-d798-4a14-8385-e926de9233d5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064657 Oct 19 13:25:41.993853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 569/1216] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:43.011018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:43.014992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:43.023236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:43.023899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:43.024563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:43.025841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:43.026650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:43.027401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:43.082259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af1ae07b-1656-43c3-a0ec-ed74759964ba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077102 Oct 19 13:25:43.083131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 648/1217] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:44.097006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:44.099895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:44.108159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:44.108814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:44.109366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:44.110306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:44.111028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:44.111751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:44.163370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-43580ac4-71e4-47de-83d3-afc4aca9339a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068846 Oct 19 13:25:44.163370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 570/1218] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:45.180734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:45.184374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:45.196046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:45.196782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:45.197250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:45.198135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:45.198590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:45.199130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:45.238782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-14aee507-ae3e-492d-97c8-287cedfb7877 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065388 Oct 19 13:25:45.239373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 649/1219] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:46.255839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:46.259669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:46.270050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:46.270827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:46.271430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:46.272371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:46.273135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:46.273860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:46.322093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-31fa6ff4-765b-485b-a1e2-55c5edc7c2e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073720 Oct 19 13:25:46.322672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 571/1220] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:47.340108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:47.342642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:47.352557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:47.353307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:47.353839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:47.354894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:47.355426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:47.356122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:47.415590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fa5fa6d0-ce1a-4214-9bbd-c4d45d323785 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080470 Oct 19 13:25:47.416584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 650/1221] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:48.436406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:48.440107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:48.446959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:48.447435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:48.447865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:48.448559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:48.449024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:48.449443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:48.488606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9c3377b-e67b-4abe-ab11-17ec13240501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059121 Oct 19 13:25:48.489597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 572/1222] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:49.508121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:49.512073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:49.523373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:49.524234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:49.525053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:49.526281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:49.527042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:49.527695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:49.535528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=87 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:49.579802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2bc91231-4197-44c5-9c11-e31c7f13527e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078240 Oct 19 13:25:49.584903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 651/1223] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:50.594506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:50.596595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:50.603853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:50.604340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:50.604909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:50.605630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:50.606110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:50.606528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:50.609257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=83 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:25:50.643268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2a18361d-5497-4714-bda1-30269bf2ef43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053318 Oct 19 13:25:50.644173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 573/1224] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:51.660607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:51.663709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:51.673775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:51.674262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:51.674691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:51.675395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:51.675841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:51.676256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:51.710694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4d1a32d-8df1-4af7-9ada-65d90f653b7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057651 Oct 19 13:25:51.711423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 652/1225] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:52.731751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:52.733851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:52.741260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:52.741735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:52.742156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:52.742848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:52.743287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:52.743705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:52.775672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-487a17d8-69c8-49db-af35-dad5243d09a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051487 Oct 19 13:25:52.776730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 574/1226] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:53.795096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:53.798929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:53.810270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:53.811030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:53.811795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:53.813054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:53.813875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:53.814645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:53.860723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b6e8e79a-77d6-4346-9d07-0b36927a4205 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072342 Oct 19 13:25:53.861513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 653/1227] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:54.874457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:54.876932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:54.883918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:54.884396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:54.884823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:54.885878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:54.886321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:54.886735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:54.938208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a7d0a923-5275-49fd-873b-f67390565d5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067759 Oct 19 13:25:54.938988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 575/1228] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:55.950896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:55.953262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:55.960481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:55.961031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:55.961471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:55.962321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:55.962818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:55.963260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:56.005415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f2edb0c8-e069-4833-98e8-f74d6b9f8746 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058115 Oct 19 13:25:56.006669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 654/1229] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:25:57.082541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:57.086121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:57.096684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:57.097494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:57.098201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:57.099789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:57.100273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:57.100787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:57.145868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0da6e035-4ac4-4006-aebb-c242c6c4c040 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127744 Oct 19 13:25:57.148987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 576/1230] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:58.164322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:58.167446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:58.176714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:58.177593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:58.178261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:58.179225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:58.179910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:58.180513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:58.221439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b1dd94fc-2416-4ba0-b8f5-7a54813ca7bd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063299 Oct 19 13:25:58.222033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 655/1231] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:25:59.236933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:25:59.239768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:25:59.251200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:59.251891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:59.252396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:59.253666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:25:59.254216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:25:59.254705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:25:59.291646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-977977cb-5789-4fa8-b98f-bc20b8170645 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060498 Oct 19 13:25:59.292312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 577/1232] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:25:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:00.306891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:00.309112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:00.316772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:00.317291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:00.317725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:00.318437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:00.318887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:00.319312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:00.356666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9516d3e9-8984-40c9-b9f1-11ccf098ecbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055469 Oct 19 13:26:00.357824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 656/1233] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:01.371883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:01.374311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:01.384622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:01.385881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:01.386621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:01.387853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:01.388617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:01.389411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:01.439209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-40088a7f-cc32-4b50-af9d-7e61eefe73d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070996 Oct 19 13:26:01.440293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 578/1234] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:02.455977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:02.458265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:02.460908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:02.467015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:02.467506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:02.468039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:02.468806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:02.469473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:02.470052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:02.505657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2c04b4fc-a7d5-42b8-bd7b-270936faa4b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055547 Oct 19 13:26:02.506337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 657/1235] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:03.519687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:03.521900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:03.524297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:03.529593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:03.530070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:03.530499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:03.531198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:03.531693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:03.532231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:03.566022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f32fe45f-baa4-4352-988f-bd182fecfc08 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050578 Oct 19 13:26:03.566605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 579/1236] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:04.581995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:04.585787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:04.597301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.598155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.598937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.600184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:04.601033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:04.601783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:04.659577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-59dd3f08-3732-4d25-95fc-ee98a64e4870 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084124 Oct 19 13:26:04.660298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 658/1237] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:05.673127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:05.675970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:05.683187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:05.683674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:05.684103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:05.684816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:05.685770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:05.685770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:05.727521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dbf96b52-412c-4227-81f9-dbf5a6648688 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058579 Oct 19 13:26:05.728110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 580/1238] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:06.744140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:06.746913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:06.749937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:26:06.750120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:26:06.757105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:06.757608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:06.758048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:06.758773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:06.759223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:06.759987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:06.795308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-89cbf774-d552-4004-a1c3-891d31f51c34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056613 Oct 19 13:26:06.795896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 659/1239] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:07.811595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:07.815259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:07.818302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:26:07.818522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:26:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:26:07.829226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:07.829984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:07.830656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:07.831402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:07.831907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:07.832338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:07.871892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6e0b368f-783c-448a-aa42-485b731d0d28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067383 Oct 19 13:26:07.872652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 581/1240] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:08.891401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:08.895024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:08.904897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:08.905748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:08.906204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:08.907389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:08.908164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:08.908926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:08.949088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-335073e1-04b2-43d2-80f5-49e3a142d59c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064485 Oct 19 13:26:08.950098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 660/1241] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:09.964593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:09.967625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:09.980691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:09.981190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:09.981715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:09.982429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:09.982869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:09.983283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:10.028809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a22e6666-cce6-4198-a1ec-5b85be00cf82 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069875 Oct 19 13:26:10.029804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 582/1242] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:11.045771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:11.049533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:11.057711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:11.058410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:11.058857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:11.059757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:11.060567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:11.061260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:11.098318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed27ef4c-0397-43a6-967e-acc9b15fda8a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057517 Oct 19 13:26:11.098899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 661/1243] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:12.112004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:12.115227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:12.124980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:12.125810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:12.126543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:12.127704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:12.128397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:12.129074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:12.173457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8ef361e-a470-4c26-9791-05274e18bb5f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066577 Oct 19 13:26:12.174589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 583/1244] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:13.189791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:13.192092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:13.199541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:13.200165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:13.200716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:13.201602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:13.202180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:13.202662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:13.240669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb2f282b-2f93-4c9d-a18a-7b178cffcd86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054829 Oct 19 13:26:13.242545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 662/1245] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:14.255950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:14.258154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:14.265881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:14.266743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:14.267161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:14.267903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:14.268358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:14.268840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:14.305787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ae5ab11d-477c-4810-a591-491745747fea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054456 Oct 19 13:26:14.305787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 584/1246] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:15.322949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:15.325975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:15.333565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:15.334063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:15.334504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:15.335235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:15.335690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:15.336115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:15.371565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e8306d62-0588-4fe9-9d23-d9076f3ffb59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052810 Oct 19 13:26:15.372420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 663/1247] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:16.386591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:16.389249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:16.397401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:16.397921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:16.398361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:16.399095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:16.399553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:16.399976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:16.442006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-db4c357b-665f-4c57-92a4-d6cb073b70db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059969 Oct 19 13:26:16.442777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 585/1248] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:17.459992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:17.463540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:17.475905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:17.476703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:17.477525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:17.478777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:17.479546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:17.480283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:17.519622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8258e17b-872a-44d3-a4ee-4156743fd716 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067808 Oct 19 13:26:17.520252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 664/1249] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:18.535126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:18.537426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:18.544259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:18.544777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:18.545237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:18.545931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:18.546370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:18.547126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:18.579153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0b88c6b6-c0b4-4dc6-83bd-18535ed4fae2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048253 Oct 19 13:26:18.579763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 586/1250] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:19.598324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:19.603131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:19.611313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:19.611795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:19.612228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:19.612957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:19.613401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:19.613816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:19.616752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:19.657874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2c1ed915-a9f7-4235-8d59-abda2c3979ac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067097 Oct 19 13:26:19.658462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 665/1251] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:20.672988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:20.675829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:20.683521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:20.684134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:20.684690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:20.685692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:20.686346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:20.687011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:20.690253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6cea5fd3-e229-4f2f-9d29-ebbf7daef9f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085113 Oct 19 13:26:20.754167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 587/1252] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:21.768713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:21.771065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:21.782686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:21.782686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:21.782686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:21.782686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:21.783215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:21.783215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:21.816539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9dd75071-9d5b-44eb-83f7-43d637fc90f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052267 Oct 19 13:26:21.817174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 666/1253] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:22.831994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:22.835614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:22.846375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:22.847178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:22.847720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:22.848603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:22.849209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:22.849836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:22.895719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-de691e44-77ae-432a-a622-c9ff420aec01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069687 Oct 19 13:26:22.896299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 588/1254] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:23.910268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:23.912563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:23.920310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:23.920728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:23.921213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:23.922062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:23.922704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:23.923135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:23.960924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-15a7fb52-c953-4339-b645-01400cbf9ffa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054898 Oct 19 13:26:23.961897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 667/1255] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:24.976508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:24.978874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:24.986366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:24.986864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:24.987295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:24.988020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:24.988556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:24.989038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:25.025945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-306d8b89-036e-4390-a998-00428897dce7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053434 Oct 19 13:26:25.026948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 589/1256] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:26.045723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:26.049580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:26.060482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:26.061393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:26.062180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:26.063305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:26.064108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:26.064843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:26.123737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-66613fa7-256f-499c-8137-0e4bfd859923 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084819 Oct 19 13:26:26.124362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 668/1257] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:27.142214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:27.145778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:27.151452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:26:27.151733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:26:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:26:27.163244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:27.164108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:27.164908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:27.166738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:27.167113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:27.167906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:27.232427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ac90c514-4289-46a8-99dc-c1e72bbd51a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095552 Oct 19 13:26:27.233893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 590/1258] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:28.248806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:28.251750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:28.265122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:28.266500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:28.267053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:28.267804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:28.268265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:28.268690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:28.309775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-356f59b5-3be2-4c66-83f8-4743c79127ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067002 Oct 19 13:26:28.310382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 669/1259] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:29.328830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:29.332528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:29.340885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:29.341378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:29.341821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:29.342634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:29.343423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:29.344186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:29.396319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b60fcca9-6fbc-44e4-9fed-72b13010d2b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075915 Oct 19 13:26:29.397455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 591/1260] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:30.414645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:30.416931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:30.425099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:30.425592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:30.426034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:30.426786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:30.427246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:30.427677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:30.464106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd200655-afb4-43fc-90f8-2ec7583649d2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053909 Oct 19 13:26:30.464756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 670/1261] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:31.481426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:31.485419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:31.496104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:31.496837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:31.497607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:31.498804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:31.500017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:31.500900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:31.553200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-afef952a-525d-45ad-b8ee-50f927b855e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076474 Oct 19 13:26:31.553200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 592/1262] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:32.569249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:32.572962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:32.576537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:32.584782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:32.585449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:32.585981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:32.586838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:32.587387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:32.587907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:32.626218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9984d5bf-e010-45ef-85ca-a796a38b621f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064198 Oct 19 13:26:32.627424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 671/1263] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:33.644721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:33.648333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:33.651425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:33.658664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:33.659386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:33.660166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:33.661089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:33.661614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:33.662242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:33.705172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-32cb3732-3a0f-4071-bd74-7b9872d72a36 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067371 Oct 19 13:26:33.706173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 593/1264] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:34.725813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:34.730319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:34.738167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:34.738655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:34.739552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:34.740062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:34.740494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:34.740906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:34.784008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-18c4c6e3-ae10-4a19-9b28-7ba635438d5a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066292 Oct 19 13:26:34.784596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 672/1265] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:35.803335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:35.806876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:35.815136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:35.815711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:35.816202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:35.817180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:35.817691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:35.818200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:35.882560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-94b686c0-84a7-4e1e-9c82-7816844a71e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085271 Oct 19 13:26:35.884294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 594/1266] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:36.898878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:36.901070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:36.908372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:36.908941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:36.909505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:36.910267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:36.910761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:36.911323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:36.954116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01544428-6df9-4298-bdbc-d43e6b4fa28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059038 Oct 19 13:26:36.955390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 673/1267] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:37.972080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:37.975226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:37.982489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:37.983024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:37.983596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:37.984444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:37.984980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:37.985518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:38.021994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3ff7efc5-ed00-4335-9171-db1a2f6d234e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055602 Oct 19 13:26:38.022881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 595/1268] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:39.035592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:39.037876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:39.045357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:39.045888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:39.046443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:39.047490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:39.048064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:39.048545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:39.105717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c58b22a4-0fe4-452a-bce4-f9effe1be83b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074047 Oct 19 13:26:39.107359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 674/1269] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:40.125914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:40.128765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:40.140210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:40.141115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:40.141852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:40.143012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:40.143560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:40.143987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:40.178448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a75c4227-fb78-4c3f-95e5-0abd91458199 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058490 Oct 19 13:26:40.179032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 596/1270] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:41.192932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:41.195581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:41.202596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:41.203270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:41.203893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:41.204841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:41.205669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:41.206231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:41.252668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1f25eeb7-0e04-4f0b-8912-e3d8092cf586 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064602 Oct 19 13:26:41.253737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 675/1271] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:42.270997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:42.274624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:42.282638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:42.283118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:42.283544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:42.284247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:42.284694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:42.285133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:42.320598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a0fd144e-caaa-4889-84da-e90e109accd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057228 Oct 19 13:26:42.321210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 597/1272] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:43.335476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:43.337777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:43.345189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:43.345682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:43.346181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:43.346900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:43.347351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:43.347816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:43.382800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3e043312-c776-4bc2-a4ee-7fabb5f4412a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051442 Oct 19 13:26:43.383475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 676/1273] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:44.400623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:44.404350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:44.418187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:44.419023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:44.419788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:44.421514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:44.421970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:44.422730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:44.470275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c05ff562-95f8-4c6f-b74b-ab351ab16da9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076653 Oct 19 13:26:44.471302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 598/1274] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:45.486965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:45.489200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:45.498623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:45.499530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:45.500371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:45.501245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:45.502003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:45.502684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:45.544242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af5ca923-fa66-4f92-b357-c3577bd3ee86 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062672 Oct 19 13:26:45.545303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 677/1275] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:46.561613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:46.564027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:46.571675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:46.572188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:46.572644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:46.573418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:46.573900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:46.574375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:46.616148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3df7af55-8dba-48c9-9142-7a53f41e58db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058733 Oct 19 13:26:46.616729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 599/1276] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:47.631976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:47.634549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:47.641674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:47.642167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:47.642607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:47.643328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:47.643786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:47.644216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:47.678558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a5a901d4-fc70-405c-97fa-b51b0e393b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052819 Oct 19 13:26:47.679142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 678/1277] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:48.693205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:48.696689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:48.706081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:48.706929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:48.707693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:48.709006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:48.709809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:48.710564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:48.765187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d735217f-b1d7-4e36-bb16-1c6dee3b149c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076084 Oct 19 13:26:48.766384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 600/1278] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:49.786718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:49.788939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:49.795617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:49.796181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:49.796708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:49.797502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:49.798076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:49.798937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:49.801129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:49.832406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a8207e9e-9d56-46e0-81b1-31b35c425490 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057484 Oct 19 13:26:49.833023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 679/1279] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:50.848120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:50.850406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:50.861123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:50.861608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:50.862037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:50.862768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:50.863218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:50.863675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:50.866392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:26:50.898630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7101fa8f-bc14-4669-8cb2-974f234e1f56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055051 Oct 19 13:26:50.899373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 601/1280] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:51.913671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:51.915984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:51.923214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:51.923700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:51.924132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:51.924846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:51.925321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:51.925753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:51.961433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-afcfbd97-1e44-4175-822d-04af01c2a5b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052075 Oct 19 13:26:51.962030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 680/1281] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:52.975476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:52.977725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:52.989001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:52.989490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:52.989931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:52.990879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:52.991328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:52.991776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:53.029468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5a4fefbd-65f9-4c5e-9687-ce0499991045 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057982 Oct 19 13:26:53.030019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 602/1282] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:54.042748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:54.044949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:54.052376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:54.053086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:54.053619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:54.054466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:54.055013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:54.055533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:54.111058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3917a3b6-9856-4cad-8756-54f4648d6ce5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071854 Oct 19 13:26:54.111567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 681/1283] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:55.126310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:55.128485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:55.135706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:55.136188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:55.136622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:55.137547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:55.138028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:55.138622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:55.171979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-67893115-60dc-482d-bbd4-dbd2d1d7224e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049776 Oct 19 13:26:55.172557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 603/1284] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:56.185744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:56.188188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:56.195269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:56.195766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:56.196204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:56.196944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:56.197402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:56.197827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:56.231946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-edd46130-e5e5-4a59-ac2a-1ab010a4ec05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050315 Oct 19 13:26:56.232524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 682/1285] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:26:57.245242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:57.247723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:57.255508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:57.255997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:57.256458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:57.257267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:57.257900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:57.258726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:57.293336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cf731626-377e-48ed-95f0-7ec2585b5192 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052084 Oct 19 13:26:57.294264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 604/1286] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:58.308235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:58.311934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:58.321859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:58.322601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:58.323359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:58.324592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:58.325433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:58.326154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:58.382795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-35a692bb-5e09-4792-904b-7c590bb38ca1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079181 Oct 19 13:26:58.384080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 683/1287] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:26:59.398950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:26:59.401185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:26:59.408304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:59.408773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:59.409226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:59.409922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:26:59.410362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:26:59.410770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:26:59.443496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-289449c8-211b-42ff-9ea9-7148f52c0113 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048605 Oct 19 13:26:59.444104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 605/1288] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:26:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:00.458916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:00.461032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:00.467812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:00.468540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:00.469084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:00.469864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:00.470441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:00.470948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:00.509684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6209dcad-50cd-4a9a-b31b-1f39eafc3dcb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056762 Oct 19 13:27:00.510313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 684/1289] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:01.524302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:01.526601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:01.535540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:01.536018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:01.536435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:01.537173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:01.537612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:01.538028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:01.570777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3739b6ae-e8e3-48eb-b3de-066f7cadbdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050838 Oct 19 13:27:01.571219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 606/1290] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:02.587177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:02.590187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:02.594041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:02.601727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:02.602241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:02.602984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:02.604294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:02.604935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:02.605688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:02.646657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f2139e97-4ec6-4c5f-bb2a-14ec542fa63c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063049 Oct 19 13:27:02.647689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 685/1291] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:03.662057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:03.664244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:03.666665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:03.672733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:03.673245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:03.673677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:03.674383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:03.674824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:03.675240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:03.708453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-277b7b3f-1fbb-4962-b970-7e69092ee1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Oct 19 13:27:03.709059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 607/1292] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:04.724038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:04.727001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:04.734601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:04.735098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:04.735577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:04.736400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:04.736853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:04.737297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:04.775384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8c8cc338-9b44-4e09-8dad-17ccd2196074 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056284 Oct 19 13:27:04.775977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 686/1293] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:05.792256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:05.794520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:05.801583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:05.802102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:05.802563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:05.803329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:05.803818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:05.804337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:05.845238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ea9ae30d-c7ad-446f-8924-8e5fecbe39a8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056740 Oct 19 13:27:05.846077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 608/1294] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:06.861531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:06.864024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:06.872145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:06.872846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:06.873789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:06.875090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:06.875841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:06.876551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:06.925825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9fd9b87e-cd1b-4bcb-8051-5cb24bb664a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068168 Oct 19 13:27:06.926642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 687/1295] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:07.941220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:07.943295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:07.954133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:07.954747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:07.955408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:07.956502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:07.957256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:07.957955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:07.995203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-75b44a2b-9579-4cfb-8a17-bcefd2e42dfa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058395 Oct 19 13:27:07.995780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 609/1296] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:09.018240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:09.018240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:09.021472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:09.021472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:09.021709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:09.022519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:09.022973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:09.023398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:09.056969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6e7e8d1c-1439-4b10-8736-dd85a5fc2756 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051507 Oct 19 13:27:09.057560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 688/1297] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:10.072437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:10.074860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:10.085583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:10.086347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:10.086914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:10.088014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:10.088735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:10.089445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:10.125733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-51cbce42-22df-43a4-bab5-672ff3d402b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058137 Oct 19 13:27:10.126647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 610/1298] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:11.139915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:11.142016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:11.148758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:11.149281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:11.149722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:11.150423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:11.150872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:11.151288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:11.186983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cfd97f7d-fef6-40b1-b4b6-f89e97ad87cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051157 Oct 19 13:27:11.188995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 689/1299] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:12.200140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:12.202412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:12.209475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:12.209945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:12.210374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:12.211071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:12.211509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:12.211963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:12.253439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-88553a9f-5a18-44d8-a1c4-e01921afb68b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057456 Oct 19 13:27:12.254016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 611/1300] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:13.267730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:13.269855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:13.277154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:13.277647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:13.278093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:13.278809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:13.279265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:13.279720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:13.325029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-039c31dd-fa73-4058-a094-bbcd6879d6e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061614 Oct 19 13:27:13.325473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 690/1301] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:14.338574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:14.340961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:14.348196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:14.348672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:14.349128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:14.349830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:14.350304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:14.350744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:14.384014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5cd03609-cf5c-4833-a163-11f34ace412e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049367 Oct 19 13:27:14.384581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 612/1302] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:15.399304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:15.401552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:15.409777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:15.410268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:15.410698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:15.411411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:15.411860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:15.412279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:15.452012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cbc8ef92-2d91-48f0-bd36-f70390549f49 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056453 Oct 19 13:27:15.452484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 691/1303] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:16.464517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:16.466778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:16.475081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:16.475571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:16.476035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:16.476726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:16.477205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:16.477627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:16.512423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e28d985e-bdfd-45ac-a943-0a82d9c9c299 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051966 Oct 19 13:27:16.513043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 613/1304] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:17.525610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:17.527813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:17.535142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:17.535725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:17.536507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:17.537824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:17.538645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:17.539405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:17.584852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f363552f-f25b-4ae3-b048-824d8409ad21 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063150 Oct 19 13:27:17.585343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 692/1305] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:18.598832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:18.601072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:18.607718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:18.608271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:18.608855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:18.609627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:18.613005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:18.619040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:18.652754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4d64d472-95bc-458b-86c7-faff6cb5cde9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058361 Oct 19 13:27:18.653342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 614/1306] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:19.667090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:19.669359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:19.675820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:19.676356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:19.676833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:19.677631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:19.678195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:19.678780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:19.712101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1a74eac-8b10-476a-a308-a358e5302328 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049198 Oct 19 13:27:19.712579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 693/1307] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:20.728760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:20.732051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:20.741295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:20.741780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:20.742207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:20.742910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:20.743356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:20.743773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:20.776301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-815c8426-7554-439d-8324-aa0cfd8c5b1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054343 Oct 19 13:27:20.776882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 615/1308] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:21.790096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:21.792260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:21.799135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:21.799622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:21.800053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:21.800754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:21.801227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:21.801671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:21.804240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=90 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:21.835786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dd2cd27b-e02d-40fe-96ae-f6134da1ecf2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049759 Oct 19 13:27:21.836242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 694/1309] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:22.851302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:22.853522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:22.860799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:22.861314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:22.861741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:22.862440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:22.862883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:22.863298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:22.866312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=90 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:22.902594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-693e3335-ab7c-4777-9971-27ceda75577d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055196 Oct 19 13:27:22.903060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 616/1310] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:23.918788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:23.921364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:23.928606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:23.929131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:23.929568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:23.930274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:23.930723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:23.931164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:23.964409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4cb2bcb9-3d77-43fd-b014-62152fbb2950 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049604 Oct 19 13:27:23.965010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 695/1311] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:24.978572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:24.981794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:24.988943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:24.989435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:24.989869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:24.990581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:24.991023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:24.991450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:25.025101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c581164-8fc2-4c2d-bc54-b485375c0a56 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050531 Oct 19 13:27:25.025657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 617/1312] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:26.040885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:26.045518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:26.052974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:26.053469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:26.053932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:26.054684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:26.055133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:26.055556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:26.092267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-517011d5-2d10-4360-9451-5857c6797838 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057315 Oct 19 13:27:26.093579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 696/1313] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:27.106124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:27.108511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:27.115876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:27.116539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:27.117008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:27.117711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:27.118153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:27.118567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:27.152089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9efe3a30-4401-4ee8-99e1-9ba2b4738d25 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049929 Oct 19 13:27:27.152654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 618/1314] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:28.165966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:28.168276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:28.176226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:28.176733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:28.177192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:28.177894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:28.178344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:28.178760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:28.212725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-63631a59-c6c1-49e2-936f-b0e14c0e04c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050961 Oct 19 13:27:28.213344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 697/1315] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:29.230105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:29.233521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:29.244001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:29.244816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:29.245607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:29.246814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:29.247374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:29.247962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:29.286766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7f912012-bdbf-4141-a374-a58d48677694 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063084 Oct 19 13:27:29.287343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 619/1316] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:30.299953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:30.302209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:30.309174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:30.309665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:30.310137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:30.311031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:30.311591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:30.312024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:30.360744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-074bbf21-c289-4ae8-a0fd-81d0390278b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064922 Oct 19 13:27:30.361483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 698/1317] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:31.377002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:31.380716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:31.389538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:31.390011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:31.390434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:31.391132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:31.391571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:31.391979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:31.433720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-006ced18-faf7-45cb-bffb-4795e18e8b24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061791 Oct 19 13:27:31.434294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 620/1318] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:32.449868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:32.452346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:32.459502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:32.460129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:32.460648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:32.461646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:32.462371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:32.463076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:32.510126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ca17c9db-ca90-4559-8c68-b90cca394c74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064665 Oct 19 13:27:32.510662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 699/1319] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:33.528396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:33.532190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:33.543389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:33.544201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:33.545072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:33.546510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:33.547325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:33.547897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:33.596343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12bc500f-b964-45fb-a3c0-cecfebac028e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075223 Oct 19 13:27:33.596944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 621/1320] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:34.613094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:34.615227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:34.617798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=30 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:34.623877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:34.624455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:34.624929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:34.625635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:34.626093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:34.626520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:34.662742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51122484-e049-4ec0-89df-bc758923ace9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054356 Oct 19 13:27:34.663337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 700/1321] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:35.677001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:35.679511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:35.682438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=30 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:35.689109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:35.689598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:35.690033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:35.690745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:35.691201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:35.691621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:35.744295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8a8b09a5-ce9d-4742-aede-8f76335e3f06 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072361 Oct 19 13:27:35.745145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 622/1322] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:36.761532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:36.763742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:36.770567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:36.771046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:36.771481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:36.772176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:36.772633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:36.773169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:36.808308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c9cdcf1-ceb9-4bba-9fce-f05dcdd3d0f8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051112 Oct 19 13:27:36.808837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 701/1323] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:37.824747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:37.829219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:37.834127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:37.834629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:37.835057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:37.835754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:37.836201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:37.836670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:37.873118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-962aebd1-5f93-4ad9-b9c3-a3708cf38c4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056271 Oct 19 13:27:37.873700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 623/1324] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:38.887022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:38.889389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:38.896969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:38.897830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:38.898580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:38.899621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:38.900458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:38.901219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:38.944267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2ea6d3f8-5a28-4ea4-9690-72c5647dc593 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061973 Oct 19 13:27:38.944838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 702/1325] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:39.957200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:39.959402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:39.966540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:39.967122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:39.967646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:39.968219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:39.968724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:39.969249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:40.006065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-39c4b251-1455-4d94-9504-a2c05af26e3c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053644 Oct 19 13:27:40.006628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 624/1326] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:41.023528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:41.025995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:41.033029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:41.033516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:41.033948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:41.034746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:41.035337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:41.035671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:41.073975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74955657-38a7-423a-a3d9-273e980394dd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054718 Oct 19 13:27:41.074638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 703/1327] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:42.087334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:42.089527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:42.096662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:42.097170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:42.097590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:42.098279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:42.098711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:42.099122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:42.134210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-996444c9-a49c-4f3e-b566-435ec0e8e876 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050805 Oct 19 13:27:42.134879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 625/1328] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:43.152033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:43.160255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:43.162577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:43.163072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:43.163509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:43.164270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:43.164728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:43.165231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:43.197268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5a87c37b-1243-456c-95bb-617371c15f8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050277 Oct 19 13:27:43.197832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 704/1329] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:27:44.211028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:44.213543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:44.221168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:44.221648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:44.222077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:44.222772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:44.223206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:44.223622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:44.257002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8fd344a4-303e-4e31-b2ce-d990bb4d1f55 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050138 Oct 19 13:27:44.258037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 626/1330] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:45.272528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:45.274968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:45.282712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:45.283202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:45.283793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:45.284586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:45.285235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:45.285768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:45.324317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c5934bf0-a7ff-49a2-b9dd-23873563fdc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056412 Oct 19 13:27:45.324898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 705/1331] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:46.340301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:46.344022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:46.353901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:46.354497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:46.355021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:46.355889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:46.356452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:46.357009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:46.392730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2ee7af64-63a3-4fde-8b2f-4e5418a28354 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059076 Oct 19 13:27:46.393346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 627/1332] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:47.408709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:47.411159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:47.418836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:47.419340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:47.420524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:47.420742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:47.421085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:47.421521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:47.457442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f360903-c0e4-4800-8637-e9cde44f07a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054061 Oct 19 13:27:47.458046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 706/1333] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:48.476486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:48.480752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:48.490426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:48.491007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:48.491552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:48.492486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:48.493159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:48.493642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:48.528802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bc77533f-a684-4ff2-afd7-6910ddcebd43 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061380 Oct 19 13:27:48.529632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 628/1334] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:49.544935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:49.548471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:49.555930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:49.556418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:49.556980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:49.558025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:49.558591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:49.559334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:49.596308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-88f27ec1-a309-4c03-b7a2-01443c97b11b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057791 Oct 19 13:27:49.596942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 707/1335] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:50.613684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:50.617085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:50.626851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:50.627519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:50.628237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:50.629461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:50.630226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:50.630908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:50.680949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8afac91b-5309-4144-bd21-981b4f18f1f5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074249 Oct 19 13:27:50.681764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 629/1336] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:51.699114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:51.702553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:51.710043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:51.710868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:51.711413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:51.712464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:51.713384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:51.714149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:51.759989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-330a30f1-ca29-4dcb-82d0-fd906e9a9450 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066731 Oct 19 13:27:51.760993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 708/1337] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:52.772767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:52.775128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:52.784313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:52.785202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:52.785801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:52.787279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:52.787643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:52.788341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:52.830164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3fe491c7-819c-40c1-80b1-cb6526d80126 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061420 Oct 19 13:27:52.831041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 630/1338] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:53.845450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:53.847547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:53.855169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:53.855676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:53.856090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:53.856833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:53.857422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:53.858156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:53.862477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=90 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:53.894494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-872a749b-dc00-4cf5-ac0a-a88f60c14090 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053320 Oct 19 13:27:53.895052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 709/1339] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:54.909577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:54.911766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:54.919120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:54.919659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:54.920083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:54.920795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:54.921281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:54.921700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:54.924515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=90 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:27:54.961119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a8bafa4b-e19e-4fc4-901b-c620b05938f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056348 Oct 19 13:27:54.961567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 631/1340] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:55.976422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:55.978645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:55.988017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:55.988541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:55.989000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:55.989708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:55.990150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:55.990562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:56.024553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2b9709af-f707-4598-9656-1a3d129660f4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052249 Oct 19 13:27:56.025252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 710/1341] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:57.042676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:57.046303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:57.056846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:57.057602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:57.058354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:57.059393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:57.060212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:57.060974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:57.102115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-315778f1-32ef-4f51-b987-93e466d089a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067250 Oct 19 13:27:57.102767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 632/1342] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:58.122300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:58.126088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:58.138231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:58.138810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:58.139426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:58.140292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:58.140940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:58.141609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:58.188970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d2e2ba16-cd5c-43be-89aa-6d11f57f8e46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073812 Oct 19 13:27:58.189531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 711/1343] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:27:59.202196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:27:59.204517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:27:59.211674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:59.212444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:59.212899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:59.213613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:27:59.214060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:27:59.214488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:27:59.247752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6b5176a6-e390-498e-ab28-73ff9422304d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Oct 19 13:27:59.248334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 633/1344] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:27:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:00.262392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:00.264784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:00.271410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:00.271888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:00.272416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:00.273144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:00.273599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:00.274023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:00.315216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce22535b-c2d4-4e2e-aecd-8f5d6f50f335 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057460 Oct 19 13:28:00.316189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 712/1345] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:01.328482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:01.331653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:01.342440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:01.343072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:01.343509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:01.344304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:01.344758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:01.345218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:01.379553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86aa94a3-c83e-4f8b-938a-e4294ed448f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055409 Oct 19 13:28:01.380137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 634/1346] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:02.397623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:02.401488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:02.412946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:02.413800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:02.414563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:02.415792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:02.416583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:02.417354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:02.474098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e5abe1ef-6f50-4605-b8ec-92e922dd71ec tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083482 Oct 19 13:28:02.474988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 713/1347] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:03.491254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:03.493918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:03.504619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:03.505482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:03.506201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:03.507243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:03.507766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:03.508320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:03.551734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8a1e709a-7cd1-449b-91a1-cf7cff210214 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067066 Oct 19 13:28:03.552301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 635/1348] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:04.568848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:04.571069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:04.578616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:04.579113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:04.579553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:04.580269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:04.580720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:04.581180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:04.619877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dbcef353-fe9a-4164-852e-2f13a98178e7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054851 Oct 19 13:28:04.620779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 714/1349] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:05.635081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:05.637317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:05.644810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:05.645326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:05.645760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:05.646468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:05.646920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:05.647344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:05.683138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c9edca5e-3fab-48b2-8131-8c5545349a00 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052621 Oct 19 13:28:05.683708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 636/1350] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:06.699524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:06.702615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:06.705292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:28:06.705473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:28:06.706915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=30 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:06.715625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:06.716573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:06.717280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:06.717994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:06.718453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:06.718898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:06.761600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae04a69a-370e-445d-9a75-0f9e7d1f2cfd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068512 Oct 19 13:28:06.762692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 715/1351] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:07.788476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:07.792199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:07.795478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=30 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:07.805107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:07.805861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:07.806625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:07.807823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:07.808551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:07.809345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:07.858405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4309dece-3055-461d-99e7-3d6dc4f034d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084060 Oct 19 13:28:07.858980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 637/1352] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:08.871331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:08.873963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:08.880955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:08.881580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:08.882342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:08.883067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:08.883494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:08.883929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:08.917315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9e0be952-65b1-4b81-b10d-90b430025ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049949 Oct 19 13:28:08.917894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 716/1353] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:09.931199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:09.933412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:09.940503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:09.941134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:09.942273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:09.942273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:09.942693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:09.943107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:09.976041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3cdfb29f-cb6b-4cca-a55a-d2636096f8ab tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048996 Oct 19 13:28:09.976615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 638/1354] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:10.989520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:10.991713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:10.999098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:10.999576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:11.000006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:11.000705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:11.001303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:11.002035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:11.034286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6e5ef7df-7554-4900-a1c4-4945add9afd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048883 Oct 19 13:28:11.034872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 717/1355] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:12.051606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:12.054454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:12.062721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:12.063204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:12.063625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:12.064381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:12.064942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:12.065365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:12.099687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-edb19008-3277-40d2-ba46-884d4e5acf5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055471 Oct 19 13:28:12.100269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 639/1356] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:13.116976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:13.120316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:13.127557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:13.128043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:13.128924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:13.129378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:13.129847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:13.130261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:13.168197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6680a08b-e374-4e0a-8745-68e5a77dc83a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058902 Oct 19 13:28:13.168807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 718/1357] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:14.183064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:14.186804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:14.193685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:14.194163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:14.194625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:14.195365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:14.195805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:14.196247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:14.234444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4997dbea-f634-4924-b6fb-3e566469b887 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056943 Oct 19 13:28:14.235018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 640/1358] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:15.247800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:15.250080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:15.257125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:15.257616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:15.258045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:15.258747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:15.259198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:15.259622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:15.291261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d48e1fdf-331c-4ade-9308-d107d922dc94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047790 Oct 19 13:28:15.291844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 719/1359] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:16.304048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:16.306473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:16.314464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:16.314938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:16.315440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:16.316150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:16.316587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:16.317039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:16.348663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8bf57f70-eb1c-475a-b0cc-7e55c8152a71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Oct 19 13:28:16.349258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 641/1360] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:17.362494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:17.364728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:17.372589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:17.373212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:17.373877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:17.374588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:17.375190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:17.375659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:17.413131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9046774a-a10e-4e03-84af-8432659ea08e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054688 Oct 19 13:28:17.413704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 720/1361] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:18.426388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:18.428579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:18.435140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:18.439692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:18.439692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:18.439692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:18.439692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:18.440461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:18.470920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-caf1724a-b0f7-4c42-bdb3-d81a6a804f5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048319 Oct 19 13:28:18.471452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 642/1362] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:19.484373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:19.486603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:19.494565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:19.495061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:19.495495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:19.496206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:19.496657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:19.497115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:19.530938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-82c50f0a-2212-4db2-84af-ded6c131e475 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050989 Oct 19 13:28:19.531525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 721/1363] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:20.544329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:20.547001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:20.554441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:20.554923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:20.555350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:20.556063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:20.556510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:20.556948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:20.591803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1d25fbaa-3c13-4430-9ff3-72f2e0780b0a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Oct 19 13:28:20.592616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 643/1364] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:21.611365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:21.614333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:21.621886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:21.622817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:21.623598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:21.624761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:21.625584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:21.626357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:21.663329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dcd5591d-a7b7-4a8f-98b2-26c6a946061e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056010 Oct 19 13:28:21.664011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 722/1365] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:22.678040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:22.680142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:22.688398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:22.688910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:22.689565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:22.690348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:22.690799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:22.691217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:22.723964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9bfd0873-0760-4001-9fa6-9e3550974d44 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051486 Oct 19 13:28:22.724540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 644/1366] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:23.738713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:23.740928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:23.749572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:23.750076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:23.750521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:23.751267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:23.751754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:23.752182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:23.787744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-408a1dd8-8d44-45b3-84e8-2bdba10a28b5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053736 Oct 19 13:28:23.788324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 723/1367] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:24.800620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:24.802939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:24.810338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:24.811037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:24.811247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:24.811998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:24.812450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:24.813644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:24.849112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-14e82bbd-ea60-48b1-9287-2c40faa24099 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052805 Oct 19 13:28:24.849683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 645/1368] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:25.863126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:25.866279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:25.872918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:25.873425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:25.873851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:25.874532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:25.875042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:25.875463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:25.878334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=90 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:25.918241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed280d19-0877-467d-b035-e050bd505cc3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060632 Oct 19 13:28:25.919013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 724/1369] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:26.932620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:26.934661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:26.942541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:26.943025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:26.943457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:26.944161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:26.944606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:26.945064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:26.949318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=90 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:26.981419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d01b8221-f99d-42b9-a879-46b325e6ba45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053066 Oct 19 13:28:26.981997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 646/1370] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:27.995592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:27.997858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:28.006053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:28.006880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:28.007312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:28.007998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:28.008445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:28.009027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:28.049873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-93fdbf02-5014-492c-8a3e-d1a2255fd311 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058288 Oct 19 13:28:28.050478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 725/1371] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:29.063799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:29.066397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:29.073628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:29.074157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:29.074579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:29.075282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:29.075679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:29.076119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:29.122070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86777ea5-5afd-4976-bd61-3c03c96a7b63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062631 Oct 19 13:28:29.122711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 647/1372] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:30.136103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:30.138297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:30.152363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:30.153624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:30.155361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:30.156774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:30.157295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:30.157727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:30.196487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3ee0f5bf-6c1f-4858-b97c-2217c3b9ba11 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064857 Oct 19 13:28:30.197103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 726/1373] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:31.211098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:31.214872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:31.222845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:31.223326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:31.223793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:31.224629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:31.225834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:31.226263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:31.259916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49cadb14-e940-43a8-8c52-0b6201c6f91f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054268 Oct 19 13:28:31.260483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 648/1374] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:32.272319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:32.274667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:32.281878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:32.282406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:32.282864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:32.283572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:32.284024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:32.284448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:32.328281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d4910e7d-1737-4023-b03e-ec2c8411f31f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060208 Oct 19 13:28:32.329093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 727/1375] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:33.341391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:33.343636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:33.351376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:33.351866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:33.352294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:33.353044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:33.353479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:33.353895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:33.399113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3609283d-5642-47f3-a071-decd97709898 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061950 Oct 19 13:28:33.400069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 649/1376] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:34.416185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:34.418681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:34.426761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:34.427257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:34.427726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:34.428424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:34.428892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:34.429343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:34.465155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b981cd4-6dee-45f3-8a35-d145936d9c3a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054473 Oct 19 13:28:34.470318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 728/1377] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:35.478422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:35.480680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:35.488370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:35.488848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:35.489393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:35.490135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:35.490671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:35.491101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:35.527178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-015a5d76-be99-47f4-9767-be38abeee4af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052583 Oct 19 13:28:35.527942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 650/1378] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:36.543035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:36.545519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:36.552483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:36.553013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:36.553421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:36.554119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:36.554563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:36.554979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:36.591235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-07c6910b-7c14-44fd-9d9b-6ec9bc12cfe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052203 Oct 19 13:28:36.591806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 729/1379] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:37.604437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:37.606770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:37.614184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:37.614778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:37.615282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:37.616043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:37.616584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:37.617105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:37.651156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35a8ddfa-ffd0-4848-8e3e-3a8326e55634 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050813 Oct 19 13:28:37.652277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 651/1380] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:38.667613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:38.670051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:38.672325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=30 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:38.678437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:38.678931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:38.679364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:38.680078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:38.680527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:38.680972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:38.715676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6f422c04-898a-4ca3-a29e-7507bd972ec2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052059 Oct 19 13:28:38.716300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 730/1381] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:39.730809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:39.733014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:39.735635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=30 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:39.741453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:39.741918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:39.742351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:39.743079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:39.743503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:39.743918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:39.780456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-04edb05f-7f3f-4224-bd4e-104d816d29f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054272 Oct 19 13:28:39.781128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 652/1382] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:40.795575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:40.798057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:40.804756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:40.805261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:40.805691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:40.806388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:40.806832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:40.807245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:40.842112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fa6349ae-b925-42b4-aca2-9ceb87b20ef4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052256 Oct 19 13:28:40.842783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 731/1383] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:41.856304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:41.858500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:41.865560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:41.866156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:41.866467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:41.867435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:41.867600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:41.868004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:41.899264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-341ceb72-fa4e-4510-8f64-f7003f7d5a15 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Oct 19 13:28:41.899816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 653/1384] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:42.912361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:42.914682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:42.921700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:42.922260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:42.922852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:42.923560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:42.924015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:42.924442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:42.955703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-32951434-4509-443b-a702-51cce36d4f68 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047370 Oct 19 13:28:42.956284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 732/1385] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:43.967971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:43.970470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:43.977028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:43.977500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:43.977928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:43.978610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:43.979064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:43.979483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:44.016967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-34843a4e-81d1-408c-a84f-b8795cf492df tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052947 Oct 19 13:28:44.017536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 654/1386] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:45.036452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:45.040110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:45.051177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:45.051665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:45.052098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:45.052779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:45.053253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:45.053674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:45.085193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0e7416c3-e2fd-4083-b841-d544c302ecf4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056853 Oct 19 13:28:45.085793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 733/1387] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:46.098263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:46.100609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:46.107412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:46.107894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:46.108323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:46.109201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:46.109824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:46.110525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:46.143683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4583fff8-b3f9-4c01-bc48-82c53762f08a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050460 Oct 19 13:28:46.144264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 655/1388] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:47.159323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:47.162632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:47.169410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:47.169882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:47.170310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:47.170997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:47.171441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:47.171843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:47.202905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39f8f42b-ff49-443d-99b2-b6a85e338910 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Oct 19 13:28:47.203588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 734/1389] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:48.216048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:48.218793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:48.226053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:48.226534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:48.226962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:48.227660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:48.228115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:48.228536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:48.270127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4e616297-d192-493e-be57-4370a22ab0d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058205 Oct 19 13:28:48.270693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 656/1390] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:49.282694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:49.284926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:49.291950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:49.292443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:49.293037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:49.293621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:49.294080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:49.294515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:49.333846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce999bf6-7676-4883-aac2-8c75ee3fd6a6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055488 Oct 19 13:28:49.334433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 735/1391] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:50.350300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:50.352503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:50.359364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:50.359846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:50.360274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:50.360987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:50.361425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:50.361834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:50.396455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3333d8e4-32d1-4cc7-a93f-620f62ecbb07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053105 Oct 19 13:28:50.397057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 657/1392] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:28:51.414372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:51.418037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:51.428882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:51.429680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:51.430344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:51.431406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:51.432147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:51.432885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:51.466554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-53742179-bbca-4be0-9e55-8257eb91baa1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061013 Oct 19 13:28:51.467120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 736/1393] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:52.479892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:52.482151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:52.489373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:52.489845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:52.490262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:52.490964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:52.491402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:52.491807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:52.529208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5d8e481f-8ee1-4fed-beeb-d4ad58100b45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053234 Oct 19 13:28:52.529843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 658/1394] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:53.543642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:53.545981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:53.553451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:53.553939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:53.554380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:53.555108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:53.555567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:53.556029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:53.590351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fcd27ab1-6b01-4c2a-bf70-f2f30eecea8f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051011 Oct 19 13:28:53.590947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 737/1395] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:54.603844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:54.606082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:54.613376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:54.613854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:54.614286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:54.614994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:54.615434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:54.615851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:54.648485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-892f681f-87f9-4296-812a-d38b7aeea396 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048621 Oct 19 13:28:54.649089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 659/1396] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:55.661951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:55.664153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:55.671830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:55.672323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:55.672751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:55.673472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:55.673935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:55.674335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:55.708964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0bc36cab-cf6c-46f0-8bfd-40d83da751f0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051023 Oct 19 13:28:55.709556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 738/1397] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:56.722008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:56.724122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:56.730995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:56.731464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:56.731886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:56.732569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:56.733034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:56.733446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:56.766259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-be172afb-aacb-4590-a33e-a469fc9c0839 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048382 Oct 19 13:28:56.766818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 660/1398] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:57.779264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:57.781801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:57.788777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:57.789295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:57.789725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:57.790434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:57.790909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:57.791303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:57.793800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=90 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:57.823137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b93418f-2ba6-4308-be86-fc3b554b613e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048023 Oct 19 13:28:57.823733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 739/1399] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:58.835887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:58.838083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:58.845099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:58.845578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:58.846010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:58.847238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:58.847238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:58.847559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:58.851671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=90 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:28:58.883474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6a4ede65-90c5-4ff2-984d-89cb58a5583c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051466 Oct 19 13:28:58.884058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 661/1400] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:28:59.897202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:28:59.899326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:28:59.907188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:59.907687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:59.908124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:59.908851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:28:59.909325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:28:59.909751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:28:59.943075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2aeef837-edbf-461c-91ba-9b1e3a4b095d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049979 Oct 19 13:28:59.943676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 740/1401] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:28:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:00.956588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:00.958917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:00.968161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:00.968743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:00.969546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:00.970471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:00.970963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:00.971493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:01.008660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f7fa249e-59d5-466a-b684-9d54215b139a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056515 Oct 19 13:29:01.009296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 662/1402] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:02.026108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:02.029904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:02.041185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:02.041953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:02.042542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:02.043601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:02.044403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:02.045218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:02.082498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1f8d6d53-122d-47a6-9299-244169a9d170 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063528 Oct 19 13:29:02.083081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 741/1403] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:03.095862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:03.097996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:03.105367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:03.105862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:03.106339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:03.107058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:03.107520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:03.107941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:03.144267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-abc946c1-7824-4375-be2d-009b5bc853c6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052835 Oct 19 13:29:03.144876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 663/1404] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:04.159496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:04.162675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:04.174179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:04.174948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:04.175640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:04.176955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:04.177684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:04.178430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:04.229650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e9d067b8-211f-479a-82ba-4398b362ed80 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076103 Oct 19 13:29:04.230290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 742/1405] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:05.244066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:05.246222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:05.253355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:05.253844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:05.254269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:05.254981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:05.255868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:05.256352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:05.292631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-209b6992-c9ad-4366-bd7a-63e24c0c76b8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052761 Oct 19 13:29:05.293253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 664/1406] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:06.306873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:06.309021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:06.317771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:06.318140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:06.318932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:06.320105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:06.320787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:06.321526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:06.363921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3bdedb6a-ac39-47f2-9451-5189a6929428 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061657 Oct 19 13:29:06.364824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 743/1407] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:07.381243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:07.383698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:07.394196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:07.395027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:07.395717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:07.396967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:07.397730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:07.398416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:07.435246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7789356a-64ea-47f8-a0dd-3847e7e4fc7f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058917 Oct 19 13:29:07.436181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 665/1408] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:08.449739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:08.452006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:08.461732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:08.462223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:08.462695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:08.463410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:08.463880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:08.464599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:08.502234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5a92b097-f5df-4b0e-9623-3861a7e43859 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056936 Oct 19 13:29:08.502891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 744/1409] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:09.517750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:09.520139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:09.529823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:09.530315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:09.530956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:09.531861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:09.532227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:09.532646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:09.570160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-55ed54f8-5fa0-4584-8193-4ad80ef69f4c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056587 Oct 19 13:29:09.571263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 666/1410] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:10.587369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:10.590228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:10.594592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=30 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:10.602320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:10.602908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:10.603402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:10.604689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:10.604940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:10.605335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:10.643579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dec82c39-1b1a-4262-8710-b9fda4f11114 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063003 Oct 19 13:29:10.644178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 745/1411] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:11.656778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:11.659100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:11.661645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=30 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:11.667229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:11.667785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:11.668157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:11.668901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:11.669358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:11.669785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:11.719791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-556dc902-c155-427e-ac31-8c665c15370d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066695 Oct 19 13:29:11.720397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 667/1412] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:12.734665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:12.737855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:12.746475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:12.746923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:12.747391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:12.748144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:12.748632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:12.749258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:12.784131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c1973bfb-19e0-479c-aa2a-601fa5452a24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055476 Oct 19 13:29:12.784741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 746/1413] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:13.802400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:13.806286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:13.819653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:13.820051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:13.820491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:13.821277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:13.821736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:13.822153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:13.861528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8859f144-037a-4967-ac5f-791fad53d4c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063369 Oct 19 13:29:13.862181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 668/1414] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:14.876054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:14.878922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:14.887332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:14.887889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:14.888251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:14.888993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:14.889445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:14.889872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:14.922540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5a00a902-ac62-4238-a4a9-4b9ce3d700b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050847 Oct 19 13:29:14.923105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 747/1415] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:15.935789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:15.938542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:15.945881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:15.946398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:15.946934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:15.947639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:15.948086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:15.948508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:15.990568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c5db70fd-e1a1-4ca8-81d5-ffff0e4097ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058676 Oct 19 13:29:15.991200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 669/1416] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:17.007750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:17.010000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:17.017200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:17.017797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:17.018242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:17.018950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:17.019405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:17.019825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:17.054110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c0e49171-4c7d-4142-a74a-c2ad1f01de8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050719 Oct 19 13:29:17.054991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 748/1417] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:18.068031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:18.070284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:18.076830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:18.077344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:18.077784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:18.078478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:18.078947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:18.079364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:18.117477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-845b34dd-38c1-4e96-b041-0c57aa5d5fef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053508 Oct 19 13:29:18.117937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 670/1418] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:19.132721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:19.134978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:19.142360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:19.142839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:19.143269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:19.143964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:19.144414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:19.144831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:19.177477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-49f434cb-8795-4ec1-88aa-7e43264eca69 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049160 Oct 19 13:29:19.177960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 749/1419] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:20.190973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:20.193213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:20.200256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:20.200882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:20.201498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:20.202325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:20.203441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:20.203956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:20.238827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-71f75f66-d25f-4f23-946d-2468daf67e8c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052183 Oct 19 13:29:20.239307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 671/1420] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:21.253206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:21.256029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:21.262943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:21.263433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:21.263873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:21.265321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:21.265321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:21.265726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:21.298482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8dec6116-0444-45d6-8175-e797de6a2d27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050889 Oct 19 13:29:21.298978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 750/1421] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:22.311244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:22.314014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:22.321547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:22.322048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:22.322510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:22.323592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:22.323592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:22.325902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:22.359052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bad83b5b-c224-4d24-98c8-9eec77e9ef10 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Oct 19 13:29:22.359640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 672/1422] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:23.373310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:23.376443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:23.383629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:23.384110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:23.384549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:23.385288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:23.385734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:23.386148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:23.424163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-07850e33-c45a-4302-8db9-054f5ea5fa4d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055556 Oct 19 13:29:23.424739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 751/1423] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:24.440298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:24.442505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:24.449462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:24.449939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:24.450367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:24.451059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:24.451506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:24.451922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:24.484557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2ff75f67-0c22-48b8-b6c8-f625339cc4e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048464 Oct 19 13:29:24.485147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 673/1424] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:25.498021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:25.500734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:25.508392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:25.508904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:25.509337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:25.510054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:25.510500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:25.510954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:25.544263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4149e9e6-8fa5-4a6d-97bb-87af6d9e9ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050247 Oct 19 13:29:25.544926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 752/1425] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:26.231166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:26.231798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:26.238419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:26.238903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:26.239331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:26.240029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:26.240479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:26.240935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:26.273379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:29:26.358163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [d3a80fca-bd0b-4b8f-b42a-189766d67057] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:29:26.558106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:26.560268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:26.568206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:26.568747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:26.569267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:26.570022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:26.570523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:26.570980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:26.604509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7124fcc6-fd38-4fdd-8526-6ac81ed96e32 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050776 Oct 19 13:29:26.605127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 753/1426] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:27.367435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [d3a80fca-bd0b-4b8f-b42a-189766d67057] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 58000. Oct 19 13:29:27.395918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ae32b2f4-deff-4966-9178-da1b8e58f249 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 204 len: 0 microversion: 2.1 time: 1.168218 Oct 19 13:29:27.396529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 674/1427] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:29:26 2022] DELETE /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 0 bytes in 1170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:29:27.406332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:27.407957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:27.414118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:27.414625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:27.415139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:27.415825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:27.416331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:27.416794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:27.417417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:29:27.417582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:29:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 (ip 10.222.0.17) !!! Oct 19 13:29:27.621876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:27.625968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:27.632750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:27.633254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:27.633674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:27.634372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:27.635094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:27.635798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:27.679908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c67ecbff-9702-4533-801b-a05e64be20d9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065148 Oct 19 13:29:27.680459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 675/1428] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:27.801559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:27.803807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=94 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:27.811585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4614d65b-cd67-471b-8bae-febafdb31e09 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.409937 Oct 19 13:29:27.812242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 754/1429] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:28.692142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:28.694391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:28.697048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:29:28.697193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:29:28.709254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:28.709739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:28.710168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:28.710894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:28.711321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:28.711728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:28.715645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:28.749692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e08c434f-103e-4f51-8182-3aefc08d98a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061524 Oct 19 13:29:28.750267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 676/1430] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:28.835471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:28.836212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:28.843088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:28.843583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:28.844019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:28.844721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:28.845211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:28.845629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:29.006086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:29.020230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-785d019f-99ff-4d6f-abdb-65543720f607 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188744 Oct 19 13:29:29.020990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 755/1431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:28 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:29.763841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:29.766791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:29.775794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:29.776270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:29.776706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:29.777441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:29.777887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:29.778301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:29.810954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7ded1b5c-87b2-4b36-b9b5-889289624a6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051593 Oct 19 13:29:29.811574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 677/1432] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:30.054183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:30.055216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:30.063281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:30.063781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:30.064217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:30.064971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:30.065423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:30.065844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:30.235432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:30.246452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f1796a64-5e62-4b4f-a812-bc319b84268c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.197146 Oct 19 13:29:30.246452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 756/1433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:30 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:30.827880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:30.831593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:30.842800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:30.843304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:30.843727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:30.844430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:30.844894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:30.845318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:30.881277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fcaed8fe-91a0-4d1d-92b4-ee8975c19c83 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059818 Oct 19 13:29:30.881851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 678/1434] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:31.277412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:31.278219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:31.285586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:31.286218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:31.286625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:31.287344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:31.287794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:31.288218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:31.452057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:31.468141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dc333225-e5a7-41f2-90fe-f3161ebfe0c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.195989 Oct 19 13:29:31.469379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 757/1435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:31.894572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:31.896834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:31.904147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:31.904633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:31.905174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:31.905885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:31.906332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:31.906943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:31.940415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-09ab272f-cd18-447f-93fc-a7e142ba384a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Oct 19 13:29:31.941003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 679/1436] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:32.499675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:32.502002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:32.512872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:32.512872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:32.512872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:32.512872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:32.514608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:32.514608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:32.657722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:32.666209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-04ec2fb4-af6e-4d3c-bdd5-121aff6cc9b3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176215 Oct 19 13:29:32.666775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 758/1437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:32.953570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:32.955741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:32.963072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:32.963621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:32.964053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:32.964738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:32.965233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:32.965647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:33.000918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-993c2718-9c64-4949-bd21-d9bf34e88f75 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051214 Oct 19 13:29:33.001477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 680/1438] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:33.692227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:33.693065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:33.703727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:33.704418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:33.704898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:33.705637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:33.706095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:33.706518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:33.849403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:33.851827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:29:33.851967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 (ip 10.222.0.17) !!! Oct 19 13:29:33.864317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-29a2bc19-c2be-4390-a38a-7c281dafcea8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.177747 Oct 19 13:29:33.864916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 759/1439] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:33 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:34.013519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:34.015960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:34.023164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:34.023648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:34.024079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:34.024791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:34.025279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:34.025695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:34.057717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-37149928-9ed2-4178-8160-f3c7eabc5bf5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Oct 19 13:29:34.058287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 681/1440] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:34.889111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:34.890170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:34.899954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:34.900775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:34.901563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:34.902781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:34.903575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:34.904323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:35.067130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:35.071072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:35.073392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:35.079942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-13ce356f-dadd-49b6-b29f-6c9a2e458ea6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.194452 Oct 19 13:29:35.081278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 760/1441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:34 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:35.081502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:35.081972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:35.082377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:35.083138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:35.083882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:35.084315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:35.120140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86d5ec5c-6e80-4f63-a673-1fd2ba678c77 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052987 Oct 19 13:29:35.120892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 682/1442] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:36.112844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:36.113507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:36.120086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:36.120623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:36.121151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:36.121981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:36.122504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:36.122967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:36.134796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:36.137408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:36.145455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:36.145856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:36.146284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:36.146978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:36.147424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:36.147869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:36.196097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-530ad32f-f13f-4dfa-8574-c161a4240868 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064918 Oct 19 13:29:36.197100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 683/1443] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:36.292838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:36.307839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-10581d88-fae3-4dc9-951d-0e56b3f0ebed tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.199450 Oct 19 13:29:36.308850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 761/1444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:36 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:37.212313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:37.214557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:37.221620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:37.222114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:37.222524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:37.223222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:37.223670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:37.224265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:37.256355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-64b66257-b8c3-4436-9269-f810466f3409 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Oct 19 13:29:37.256943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 684/1445] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:37.344287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:37.344977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:37.352086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:37.352605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:37.353085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:37.353792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:37.354247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:37.354677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:37.491379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:37.500091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-038a68a8-93b7-4f85-ba67-3edabb208ecf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.160162 Oct 19 13:29:37.500658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 762/1446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:38.268904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:38.271243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:38.278088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:38.278665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:38.279096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:38.279798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:38.280944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:38.281364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:38.335773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d6f90ebe-e640-4f9f-87e0-9fd135479972 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070489 Oct 19 13:29:38.336820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 685/1447] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:38.524156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:38.524807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:38.531796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:38.532284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:38.532708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:38.533439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:38.533886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:38.534304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:38.675871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:38.685587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-73c6fbb4-ba56-496a-b612-eb7ce8f8e600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165361 Oct 19 13:29:38.686307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 763/1448] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:38 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:39.352070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:39.354324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:39.361941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:39.362420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:39.362849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:39.363540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:39.363987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:39.364407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:39.395659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d83de43a-7b00-43a5-afa0-797e67fe0ef3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047604 Oct 19 13:29:39.396229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 686/1449] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:39.712541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:39.713220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:39.720467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:39.720989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:39.721430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:39.722140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:39.722590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:39.723013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:39.956357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:39.967071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b93741db-113f-4c5b-8136-d334a834269b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.260012 Oct 19 13:29:39.967929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 764/1450] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:39 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:40.408925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:40.411159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:40.418096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:40.418593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:40.419060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:40.419764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:40.420214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:40.420649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:40.453165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-74abcc9b-54d8-453c-b278-cd4a575c5ed4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Oct 19 13:29:40.453845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 687/1451] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:41.006570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:41.007432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:41.010160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=40 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:41.015782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:41.016275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:41.016710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:41.017444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:41.017895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:41.018310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:41.199195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:41.210041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2bf4a256-ffe0-47e0-8c57-b49575976c60 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.210332 Oct 19 13:29:41.210548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 765/1452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:40 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:41.468949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:41.471363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:41.478480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:41.478989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:41.479415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:41.480129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:41.480581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:41.481035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:41.516946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8a727c1-2cb4-4682-86ff-e5292e3fb85a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053994 Oct 19 13:29:41.517517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 688/1453] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:42.236124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:42.237118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:42.252538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:42.253236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:42.253684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:42.254820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:42.255483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:42.255909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:42.397278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:42.410859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-50f695bd-9fb9-4012-a372-51939091e2df tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180562 Oct 19 13:29:42.411455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 766/1454] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:42 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:42.530063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:42.533081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:42.535585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:42.541483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:42.542001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:42.542557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:42.543265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:42.543886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:42.544465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:42.579574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-55711e61-19f9-402b-a5bb-ef0ce167b689 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053589 Oct 19 13:29:42.580150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 689/1455] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:43.435090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:43.435669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:43.442651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:43.443241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:43.443712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:43.444409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:43.444887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:43.445298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:43.591823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:43.603256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:43.607704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:43.614092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cc4271da-2471-4795-9ea4-e131c3e7ae43 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182770 Oct 19 13:29:43.615243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 767/1456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:43 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:43.617088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:43.617355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:43.617781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:43.618501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:43.618929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:43.619350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:43.650490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12903036-393e-40d5-8873-2515666383fa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062507 Oct 19 13:29:43.651173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 690/1457] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:44.638640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:44.639414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:44.646408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:44.646899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:44.647343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:44.648028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:44.648479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:44.648903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:44.662813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:44.665016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:44.672600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:44.673188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:44.673617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:44.674327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:44.674771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:44.675180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:44.712518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f04d508a-5ba2-4ab1-95d1-fa1476421e88 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053600 Oct 19 13:29:44.713131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 691/1458] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:44.807834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:44.818465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c998fcd-bb22-4c05-97af-1e2c99a0e4a7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183830 Oct 19 13:29:44.819056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 768/1459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:45.727452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:45.729845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:45.736957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:45.737444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:45.737878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:45.738611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:45.739058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:45.739476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:45.768735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:45.775782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dcdd9dd3-1262-427e-99c2-73f705ee69f2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053202 Oct 19 13:29:45.776370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 692/1460] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:45.845039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:45.846883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:45.853267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:45.853772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:45.854212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:45.854962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:45.855428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:45.855856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:46.023648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:46.033676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-141076c1-0b53-4fbc-a2eb-4b31d7e4e982 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.194566 Oct 19 13:29:46.034296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 769/1461] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:45 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:46.789926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:46.792616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:46.803069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:46.803549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:46.803978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:46.804679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:46.805150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:46.805620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:46.841275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-164c1156-8806-4ff5-9ca7-91ff8ecd1302 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055851 Oct 19 13:29:46.841909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 693/1462] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:47.060772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:47.062033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:47.071043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:47.071673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:47.072232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:47.073323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:47.073858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:47.074331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:47.250367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:47.260249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6df4e775-1021-4fad-828f-0ab19f11ff47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.204980 Oct 19 13:29:47.261018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 770/1463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:47 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:47.854979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:47.857228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:47.859644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:29:47.859827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:29:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:29:47.871913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:47.872421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:47.872851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:47.873601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:47.874163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:47.874565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:47.916770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d49248d3-1583-4648-9ab3-01a89cf802f3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065372 Oct 19 13:29:47.917819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 694/1464] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:48.298033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:48.298873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:48.305806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:48.306295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:48.306727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:48.307438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:48.307887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:48.308308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:48.328787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:29:48.473758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:48.482941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6fd1eb7d-46e2-4a54-b3ad-db067db5a2d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.189248 Oct 19 13:29:48.483669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 771/1465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:48 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:48.932098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:48.934561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:48.943339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:48.943831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:48.944304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:48.945218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:48.945666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:48.946093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:48.984022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee5ed3a0-05ae-4a01-a278-5dfa93b397a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055693 Oct 19 13:29:48.984617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 695/1466] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:49.510779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:49.511644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:49.520462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:49.520993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:49.521548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:49.522528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:49.523051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:49.523650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:49.676579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:49.687116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e7d78e06-79c5-4395-821a-9357d057717d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182400 Oct 19 13:29:49.687834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 772/1467] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:49 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:49.998442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:50.000638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:50.009009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:50.009570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:50.009999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:50.010748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:50.011169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:50.011579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:50.044837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35e2c550-ba98-4a2d-88aa-10487cc3a2d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050397 Oct 19 13:29:50.045440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 696/1468] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:50.714658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:50.715952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:50.728312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:50.729252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:50.730053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:50.731344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:50.732177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:50.732981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:50.886383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:50.896693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-477ce238-e2f1-4e5b-8cab-1993ac7fc8cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188679 Oct 19 13:29:50.897332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 773/1469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:50 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:51.058153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:51.060452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:51.067646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:51.068176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:51.068608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:51.069426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:51.069809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:51.070225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:51.102481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-59a7b613-701a-4582-8f45-f2497d794cf1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048353 Oct 19 13:29:51.103040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 697/1470] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:51.922670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:51.923263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:51.930370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:51.930998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:51.931484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:51.932397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:51.933009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:51.933477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:52.089460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:52.099320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4ebebce-7c1b-4fe5-b2ce-3bebce69eed5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180614 Oct 19 13:29:52.099893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 774/1471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:52.120469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:52.122850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:52.134291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:52.134291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:52.135271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:52.135271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:52.136503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:52.136503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:52.170190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-95df89bf-8932-441e-af7a-bf765969e0a1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055100 Oct 19 13:29:52.170759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 698/1472] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:53.131951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:53.132611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:53.139893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:53.140383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:53.140824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:53.141579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:53.142035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:53.142463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:53.187925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:53.191112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:53.198391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:53.198881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:53.199309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:53.200216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:53.200665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:53.201109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:53.234491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-53d73b83-3900-420c-b381-294fd41925e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053857 Oct 19 13:29:53.235204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 699/1473] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:29:53.307090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:53.317184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c1afefbd-54f2-4888-9340-b4436db787d2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188963 Oct 19 13:29:53.318120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 775/1474] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:53 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:29:54.249059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:54.250629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:54.258305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:54.258797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:54.259229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:54.259950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:54.260399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:54.260818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:54.294970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00a39998-09b5-4b97-9fd2-06500ffa93d1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050655 Oct 19 13:29:54.295559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 700/1475] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:54.342100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:54.342817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:54.350235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:54.350758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:54.351310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:54.352214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:54.352716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:54.353258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:54.498952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:54.508507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dde4bdcb-6954-4dca-b3c5-0922e28f00fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170766 Oct 19 13:29:54.509140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 776/1476] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:54 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:55.308358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:55.311213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:55.318586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:55.319066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:55.319496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:55.320220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:55.320653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:55.321067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:55.353557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d93b5e1-15e8-47ed-a1af-1f241935d63a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049216 Oct 19 13:29:55.354122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 701/1477] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:55.544194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:55.544843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:55.553281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:55.553784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:55.554453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:55.555647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:55.556474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:55.557279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:55.723724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:55.734855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd795022-2e1d-4700-be62-9f6a1dff5fcb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.194999 Oct 19 13:29:55.736016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 777/1478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:55 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:56.366820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:56.369062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:56.376131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:56.376663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:56.377225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:56.377988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:56.379660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:56.380152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:56.429664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-086bc71e-79e2-4d7d-a860-3bf6fa74a4c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067190 Oct 19 13:29:56.430259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 702/1479] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:56.759934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:56.760547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:56.775082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:56.775575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:56.776018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:56.776726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:56.777219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:56.777663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:56.935284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:56.944098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0e2d8579-4bee-4488-9971-6da6a7f0cd82 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188699 Oct 19 13:29:56.944787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 778/1480] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:57.446108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:57.448281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:57.455368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:57.455894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:57.456427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:57.457411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:57.458001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:57.458465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:57.493476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3390f524-69dc-43c0-9b8a-0ee38709be27 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052754 Oct 19 13:29:57.494061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 703/1481] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:57.968361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:57.969129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:57.977554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:57.978377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:57.979065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:57.980184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:57.980935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:57.981623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:58.134998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:58.147256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-266e880d-3b18-49df-919b-a4dee31db811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182852 Oct 19 13:29:58.148020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 779/1482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:58.508310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:58.510408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:58.517184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:58.517658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:58.518288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:58.518904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:58.519400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:58.519822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:58.552853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d769e212-890f-4d35-88d8-6ff8a5d873fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048984 Oct 19 13:29:58.553116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 704/1483] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:29:59.182937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:59.183539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:59.190622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:59.191225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:59.191664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:59.192455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:59.192933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:59.193353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:59.364488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:29:59.373811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b8cf86b7-561f-40a9-a549-8c884a5f51d4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.195373 Oct 19 13:29:59.374390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 780/1484] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:29:59 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:29:59.565547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:29:59.568207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:29:59.575592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:59.576063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:59.576484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:59.577224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:29:59.577733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:29:59.578217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:29:59.611261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b55d820d-1ba4-47eb-897c-979d22a8da48 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049891 Oct 19 13:29:59.611960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 705/1485] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:29:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:00.399146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:00.399924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:00.406643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:00.407136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:00.407880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:00.408272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:00.408718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:00.409163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:00.580451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:00.589796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-63495ed5-bcac-4b2b-8c52-ba91f939bfaa tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.194691 Oct 19 13:30:00.590384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 781/1486] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:00.624293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:00.626578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:00.634174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:00.634649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:00.635075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:00.635769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:00.636214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:00.636624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:00.669230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8f3d305-a0b3-4f1b-985a-609bde270e78 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048905 Oct 19 13:30:00.669820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 706/1487] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:01.613592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:01.614405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:01.621087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:01.621668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:01.622166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:01.622886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:01.623327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:01.623748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:01.685720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:01.687365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:01.694446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:01.694932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:01.695359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:01.696090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:01.696532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:01.697029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:01.735127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d837b9fe-7c9d-4642-85a7-0a2b6ac306f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054977 Oct 19 13:30:01.735977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 707/1488] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:01.796811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:01.809505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-90fbb084-a2eb-4cf3-979f-059126678a9c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.199682 Oct 19 13:30:01.810053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 782/1489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:01 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:02.751495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:02.753814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:02.761990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:02.762453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:02.762877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:02.763570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:02.764008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:02.764418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:02.796780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4837f209-7ffd-4169-889b-b5892fe2e534 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049377 Oct 19 13:30:02.797347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 708/1490] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:02.834126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:02.834729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:02.841451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:02.841930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:02.842359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:02.843053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:02.843497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:02.843916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:02.975462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:02.984164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0d74e885-7295-486c-8b05-4ec1e9130cc2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.154094 Oct 19 13:30:02.984763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 783/1491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:03.811021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:03.813260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:03.820301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:03.820760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:03.821221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:03.821920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:03.822344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:03.822752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:03.837214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:03.854564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-42948aae-3ffd-48ef-a0dc-d3548476b4c8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Oct 19 13:30:03.855121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 709/1492] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:04.010873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:04.011463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:04.018566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:04.019055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:04.019482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:04.020181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:04.020628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:04.021066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:04.156082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:04.165210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d31972e7-de57-4ef7-bc79-2657e2fce2ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158219 Oct 19 13:30:04.165797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 784/1493] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:04.868232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:04.870457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:04.877900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:04.878405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:04.879316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:04.880166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:04.880625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:04.881085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:04.914958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-82e5bb92-0845-4373-b4e2-8db59f1d1e4a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050691 Oct 19 13:30:04.915844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 710/1494] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:05.188665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:05.189282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:05.196464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:05.197089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:05.197524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:05.198229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:05.198676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:05.199257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:05.353423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:05.362641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-99071637-79ef-4e3b-acf3-364a82924642 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.178020 Oct 19 13:30:05.363337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 785/1495] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:05.928750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:05.930884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:05.937683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:05.938155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:05.938584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:05.939273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:05.939716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:05.940134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:05.985156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6af03501-762d-4f8b-91ed-902283f6b17c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060483 Oct 19 13:30:05.985722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 711/1496] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:06.386255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:06.387066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:06.394055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:06.394522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:06.394987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:06.395693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:06.396158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:06.396561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:06.542421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:06.551326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f16a2e38-1687-41d9-ba3f-fb08f20c2a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168948 Oct 19 13:30:06.552013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 786/1497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:06 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:06.998524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:07.000629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:07.007894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:07.008374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:07.008798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:07.009532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:07.009970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:07.010389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:07.044481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bcedbae4-bcca-42e8-9ba5-1b741a7c1157 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050034 Oct 19 13:30:07.045075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 712/1498] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:07.576578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:07.577218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:07.584510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:07.585099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:07.585578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:07.586562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:07.587313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:07.588008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:07.740720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:07.753330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-12321feb-5c6b-47ae-98e6-2f555b2848f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180873 Oct 19 13:30:07.754266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 787/1499] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:07 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:08.057730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:08.059960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:08.066594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:08.067056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:08.067485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:08.068175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:08.068729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:08.069235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:08.110283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1d238ba6-2c42-4de6-b8d4-c744e5a8be60 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056518 Oct 19 13:30:08.110869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 713/1500] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:08.789218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:08.789842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:08.798099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:08.798707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:08.799259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:08.800271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:08.800981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:08.801483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:08.805130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:08.982869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:08.995826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9c54e6a4-2df4-4379-80ce-86dd61c245e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.211456 Oct 19 13:30:08.996698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 788/1501] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:09.123027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:09.125156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:09.132588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:09.133111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:09.133540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:09.134252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:09.134698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:09.135117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:09.169573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-40e1d7dd-7986-4319-8c86-172765807146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050496 Oct 19 13:30:09.170800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 714/1502] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:10.024641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:10.025352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:10.032466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:10.032965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:10.033412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:10.034114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:10.034750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:10.035844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:10.181164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:10.182956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:10.185220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:10.190274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae185e9b-20cf-4cc2-913c-d586c48aa854 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169631 Oct 19 13:30:10.191109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 789/1503] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:10.194413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:10.195296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:10.196117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:10.197383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:10.198033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:10.198729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:10.233637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-87351308-2599-455f-8ff0-2bf43742c933 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054557 Oct 19 13:30:10.234233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 715/1504] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:11.221857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:11.222511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:11.226322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=50 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:11.237215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:11.238012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:11.238458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:11.239235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:11.239711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:11.240143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:11.250402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:11.252572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:11.260731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:11.261609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:11.262262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:11.262968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:11.263418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:11.263837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:11.305301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-acb1c53f-ce45-483f-b3f6-1b664a66fc8b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061840 Oct 19 13:30:11.306228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 716/1505] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:11.406760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:11.415445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7949be18-e5a2-4c9c-8662-43bcf93c8fbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.197668 Oct 19 13:30:11.416010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 790/1506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:12.321198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:12.323827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:12.330828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:12.331262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:12.332393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:12.333012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:12.333466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:12.333885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:12.367237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c62a6ac5-bdb6-4994-9b56-ecd14037c36e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050642 Oct 19 13:30:12.367820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 717/1507] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:12.442172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:12.444115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:12.454482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:12.454977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:12.455415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:12.457068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:12.457068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:12.457455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:12.606747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:12.617288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-50184275-b6c8-4f54-b57c-e48a1af41c18 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.181345 Oct 19 13:30:12.617868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 791/1508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:13.381725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:13.384651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:13.388119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:13.394674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:13.395139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:13.395581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:13.396318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:13.396795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:13.397325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:13.433500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-17b97c93-7d8a-4272-b360-b96e65e71a1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056608 Oct 19 13:30:13.434083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 718/1509] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:13.642043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:13.642599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:13.649937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:13.650433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:13.650868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:13.651608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:13.652019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:13.652423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:13.805605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:13.815271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9e9644b0-79c2-468a-ac46-ef28979b41cb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.177172 Oct 19 13:30:13.815966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 792/1510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:13 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:14.446583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:14.448819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:14.460792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:14.461316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:14.461741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:14.462435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:14.462873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:14.463281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:14.499993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9c2ad627-9f3c-453f-a769-bd7d0f7636d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057394 Oct 19 13:30:14.500553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 719/1511] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:14.839095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:14.839704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:14.846534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:14.847199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:14.847649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:14.848357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:14.848807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:14.849257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:14.988960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:14.998171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c79480a9-4a6e-4de4-928a-3b39bd16fba6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162967 Oct 19 13:30:14.998735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 793/1512] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:14 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:15.513453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:15.515698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:15.523245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:15.523742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:15.524174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:15.524945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:15.525404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:15.525851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:15.557706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-29d51d08-23c6-4e79-9e1e-0569808881e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048363 Oct 19 13:30:15.558275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 720/1513] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:16.035057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:16.035616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:16.042609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:16.043090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:16.043544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:16.044252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:16.044697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:16.045155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:16.197365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:16.206693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-91c88975-73cf-4132-8608-9ba16159391e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175333 Oct 19 13:30:16.207288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 794/1514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:16.572592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:16.574761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:16.581811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:16.582285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:16.582711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:16.583405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:16.583841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:16.584249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:16.617042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1d69b629-9909-457b-8d16-1bc587237dce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050036 Oct 19 13:30:16.617632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 721/1515] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:17.230178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:17.230879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:17.238446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:17.238937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:17.239374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:17.240120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:17.241432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:17.241894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:17.386012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:17.395196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-835d6670-55b2-48a9-9244-230ec77b9a29 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169009 Oct 19 13:30:17.395772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 795/1516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:17.631427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:17.634305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:17.644682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:17.645405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:17.646047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:17.647240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:17.648037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:17.648785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:17.690069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-717568ea-d08d-4008-b2d4-8832569b9f97 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063549 Oct 19 13:30:17.690652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 722/1517] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:18.422303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:18.422945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:18.430066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:18.430635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:18.431071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:18.431794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:18.432228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:18.432669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:18.578309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:18.587319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b25994f0-3586-4145-81bc-dfbe942d7dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170528 Oct 19 13:30:18.588475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 796/1518] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:18.703304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:18.705565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:18.712964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:18.713444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:18.713897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:18.714594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:18.715032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:18.715446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:18.748782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1fad69b1-d229-49e3-acd7-6469a82be513 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049425 Oct 19 13:30:18.749380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 723/1519] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:19.615474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:19.616056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:19.623046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:19.623528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:19.623971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:19.624668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:19.625146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:19.625574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:19.762287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:19.764543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:19.772484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:19.772958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:19.773390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:19.774104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:19.774554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:19.774761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:19.774973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:19.783719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1df9027e-8b9f-47cc-b3ff-7dfa2b0f04d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175492 Oct 19 13:30:19.784472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 797/1520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:19 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:19.809019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-804712f0-b2af-455f-a25b-cf26b10c6480 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050643 Oct 19 13:30:19.809594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 724/1521] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:20.807734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:20.808370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:20.815451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:20.815925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:20.816709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:20.817400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:20.817860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:20.818291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:20.821906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:20.824604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:20.831159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:20.831639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:20.832630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:20.833447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:20.833897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:20.835009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:20.868165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7f0af9c2-a2d4-42a5-a33f-67f5ef5c6d50 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050205 Oct 19 13:30:20.868768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 725/1522] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:20.955396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:20.964917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a00264a9-de0d-4434-9c7d-3a6b1e354a36 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161064 Oct 19 13:30:20.965513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 798/1523] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:20 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:21.885616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:21.887882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:21.894572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:21.895053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:21.895480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:21.896536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:21.897146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:21.897671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:21.900713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:21.931426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0c9bb1fa-af6d-48e5-bf3e-4f0fc37b59c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051662 Oct 19 13:30:21.931980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 726/1524] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:21.993408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:21.994039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:22.004279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:22.005498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:22.006189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:22.007386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:22.008187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:22.008943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:22.172436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:22.182607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5160deee-17f5-44df-a08e-8f50f4de7167 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.195636 Oct 19 13:30:22.183181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 799/1525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:22.944764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:22.947085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:22.954091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:22.954577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:22.955084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:22.955710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:22.956189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:22.956583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:22.992821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cff7812c-6caa-488a-8e38-f83cf186e741 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052457 Oct 19 13:30:22.993447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 727/1526] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:23.206706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:23.207314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:23.214122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:23.214608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:23.215045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:23.215755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:23.216211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:23.216637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:23.384505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:23.393288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-be189367-a545-4729-96d7-f7e6f1230df9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.190454 Oct 19 13:30:23.393881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 800/1527] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:24.008440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:24.010724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:24.017846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:24.018331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:24.018754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:24.019463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:24.019912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:24.020314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:24.051809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7623e29c-fb84-4be4-9b95-3060c304208b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Oct 19 13:30:24.052496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 728/1528] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:24.418552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:24.419174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:24.425879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:24.426362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:24.427099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:24.427551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:24.428011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:24.428458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:24.573140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:24.586587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-540f2396-43b5-4034-9547-310264b325d0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171689 Oct 19 13:30:24.587571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 801/1529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:25.066725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:25.069788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:25.076562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:25.077081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:25.077511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:25.078216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:25.078662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:25.079078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:25.110933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0a9933d7-5a22-4fc2-b444-fe2fe670b1a0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049136 Oct 19 13:30:25.111510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 729/1530] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:25.616222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:25.616996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:25.624111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:25.624573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:25.625036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:25.625732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:25.626179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:25.626596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:25.768574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:25.778204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec4edbf2-c6d9-4694-b42d-d368a7ecec7d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166105 Oct 19 13:30:25.778791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 802/1531] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:25 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:26.124424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:26.126654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:26.135239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:26.135725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:26.136153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:26.136884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:26.137327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:26.137741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:26.173795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-15e17e6d-022b-4283-8078-84019b8eb12c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053661 Oct 19 13:30:26.174528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 730/1532] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:26.802748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:26.803483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:26.810477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:26.810957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:26.811388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:26.812091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:26.812534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:26.812980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:26.959112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:26.969014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a1f1596-a608-4a7e-818c-937f24a2c646 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169961 Oct 19 13:30:26.972689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 803/1533] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:27.188304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:27.190745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:27.198289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:27.198769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:27.199197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:27.199894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:27.200333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:27.200749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:27.233937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d632ef73-2e59-49db-9ba7-d75d4d275268 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049740 Oct 19 13:30:27.234504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 731/1534] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:27.996579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:27.997688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:28.007888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:28.008396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:28.008808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:28.009548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:28.009992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:28.010428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:28.197090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:28.199418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:28.207855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c2203e68-c7cf-4440-a370-4592825b7905 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.218648 Oct 19 13:30:28.208499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 804/1535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:28.247036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:28.249263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:28.256751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:28.257267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:28.257697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:28.258401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:28.258835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:28.259245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:28.320742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5dc10f1a-969f-47a2-8fea-e7adb5276ca2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077714 Oct 19 13:30:28.321965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 732/1536] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:29.232171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:29.232795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:29.239655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:29.240055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:29.240625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:29.241375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:29.241829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:29.242255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:29.335769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:29.338140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:29.345247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:29.345812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:29.346242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:29.346948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:29.347420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:29.347831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:29.385565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3e369630-038f-4211-bfd1-98bbcd294d7e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055592 Oct 19 13:30:29.386318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 733/1537] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:29.404627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:29.413634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d96beb68-7533-416d-839b-f065fb5c01dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.185633 Oct 19 13:30:29.414225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 805/1538] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:30.400623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:30.402842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:30.409653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:30.410158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:30.410622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:30.411341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:30.412293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:30.412918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:30.438497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:30.439105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:30.445866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:30.446357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:30.446826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:30.447548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:30.448002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:30.448425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:30.449892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eccdf2fb-ade7-4e23-8964-b78acf5c1ade tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053935 Oct 19 13:30:30.450463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 734/1539] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:30.597518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:30.609766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bb16cb6b-8603-496a-9590-599ddfe41b1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176568 Oct 19 13:30:30.610359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 806/1540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:30 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:31.462699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:31.464884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:31.472209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:31.472739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:31.473216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:31.473935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:31.474396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:31.474812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:31.508418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-33916278-8411-4d77-8bf2-16329b5a6d02 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049648 Oct 19 13:30:31.509082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 735/1541] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:31.634324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:31.634937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:31.641864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:31.642348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:31.642778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:31.643480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:31.643926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:31.644346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:31.792716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:31.801161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5df77e4-2808-4551-b9d8-3bd95571adb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171184 Oct 19 13:30:31.801739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 807/1542] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:32.523067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:32.526493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:32.533466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:32.534038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:32.534474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:32.535201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:32.535836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:32.536269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:32.572113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e35241d9-544f-49a2-a8d8-f19b0ba2c036 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054269 Oct 19 13:30:32.572607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 736/1543] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:32.825117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:32.825682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:32.832716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:32.833330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:32.833923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:32.834778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:32.835231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:32.835648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:32.974333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:32.983116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2fc317e7-7824-4f41-98a9-978b64ff5bf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161968 Oct 19 13:30:32.983731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 808/1544] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:33.585584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:33.587767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:33.594373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:33.594828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:33.595260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:33.596063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:33.596465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:33.596804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:33.626986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-76bad2b9-595f-406a-b5fc-1b8a7e2a5a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045663 Oct 19 13:30:33.627523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 737/1545] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:34.007426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:34.008110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:34.014806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:34.015292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:34.015734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:34.016429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:34.016925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:34.017384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:34.157302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:34.166547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-99802cf4-5571-4050-b6a5-e3f7a49dde11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163865 Oct 19 13:30:34.167144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 809/1546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:34 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:34.642400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:34.644569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:34.651674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:34.652148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:34.652583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:34.653298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:34.653743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:34.654157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:34.687306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dca7d06f-64cf-465f-ab05-127d887abefb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050907 Oct 19 13:30:34.687794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 738/1547] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:35.192283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:35.192987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:35.201901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:35.202373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:35.202817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:35.203512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:35.203976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:35.204397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:35.349563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:35.358487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c14f952f-61ba-4061-a255-154cd57ff4bf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170255 Oct 19 13:30:35.359086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 810/1548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:35.702335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:35.704535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:35.711803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:35.712282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:35.712707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:35.713512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:35.713953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:35.714367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:35.752364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ded75d3-2e8c-44e6-be87-2de1b1d58146 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054880 Oct 19 13:30:35.753639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 739/1549] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:36.383220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:36.383838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:36.390705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:36.391392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:36.391751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:36.392207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:36.392654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:36.393202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:36.545503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:36.554282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a811ff4-accb-4271-b35a-4bff228f3ef0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175067 Oct 19 13:30:36.554861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 811/1550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:36 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:36.769615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:36.772187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:36.780031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:36.780641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:36.781118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:36.781905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:36.782624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:36.783032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:36.818791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7a0d1154-b1e5-441f-b964-76a02e6955be tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053789 Oct 19 13:30:36.819233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 740/1551] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:37.579206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:37.579824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:37.586810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:37.587289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:37.587717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:37.588414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:37.588883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:37.589305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:37.734734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:37.743707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c246259b-c5c7-405d-a356-f9e595837b7f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169360 Oct 19 13:30:37.744657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 812/1552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:37.831423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:37.833638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:37.841109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:37.841595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:37.842026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:37.842733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:37.843182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:37.843600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:37.875812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-913a13eb-a236-4ff3-84b3-0ff2ec651b9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Oct 19 13:30:37.876375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 741/1553] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:38.769770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:38.770562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:38.777116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:38.777584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:38.778021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:38.778721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:38.779170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:38.779599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:38.888675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:38.893938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:38.903247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:38.904188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:38.905049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:38.906101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:38.906930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:38.907711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:38.937481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:38.943603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f786c78f-e116-4418-b851-e913c6ae815e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058817 Oct 19 13:30:38.944720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 742/1554] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:30:38.946286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:38.956686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-20e431bc-9f8c-4083-af2d-5fe83b76a8d9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.191247 Oct 19 13:30:38.957356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 813/1555] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:38 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:39.955997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:39.958633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:39.969753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:39.970365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:39.970939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:39.971975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:39.972526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:39.973078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:39.990623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:39.994140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:40.009322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-962cb854-e3f1-4396-999f-9d5b4b70cfe2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057357 Oct 19 13:30:40.010321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 743/1556] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:40.015491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:40.016693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:40.017474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:40.018696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:40.019525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:40.020313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:40.281932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:40.309683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-34e26251-5a4c-413d-8522-676d45dd9a77 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.325709 Oct 19 13:30:40.331032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 814/1557] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:39 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:30:41.025633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:41.028089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:41.035390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:41.035880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:41.036310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:41.037074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:41.037525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:41.038593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:41.074278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-30d5d610-18fe-4d9b-b5d0-427b23df7304 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053582 Oct 19 13:30:41.074856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 744/1558] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:41.338157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:41.338938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:41.341585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=50 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:41.349629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:41.350270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:41.350904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:41.351621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:41.352064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:41.352493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:41.512263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:41.526367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-40e54709-7149-4fec-8877-0944b8d5fcf3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.191867 Oct 19 13:30:41.527412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 815/1559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:41 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:42.090455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:42.092717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:42.099591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:42.100557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:42.101381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:42.101762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:42.102223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:42.102667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:42.139650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c3dfbfaf-9754-4375-9b2f-126efc261d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053765 Oct 19 13:30:42.140226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 745/1560] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:42.559616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:42.560318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:42.567900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:42.568281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:42.568725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:42.569994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:42.570334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:42.570771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:42.739480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:42.750283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dbf23001-927e-410e-927e-93cce768d0da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.195140 Oct 19 13:30:42.750873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 816/1561] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:42 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:43.152753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:43.154954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:43.161641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:43.162126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:43.162592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:43.163819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:43.164285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:43.164706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:43.201223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ac4fb504-8017-4561-8e88-f53aaacdfaaf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052341 Oct 19 13:30:43.201807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 746/1562] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:43.777094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:43.777704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:43.786061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:43.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:43.787029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:43.787727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:43.788178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:43.788656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:43.951891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:43.960522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7961d0e4-a488-4014-ae1f-23e65874d592 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188684 Oct 19 13:30:43.961259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 817/1563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:43 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:44.214246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:44.216448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:44.218972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=58 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:44.225472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:44.225958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:44.226395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:44.227201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:44.227660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:44.228076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:44.261177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-97351374-a7f2-4f40-bdbc-b8e94164c8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050899 Oct 19 13:30:44.261793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 747/1564] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:44.988382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:44.989047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:44.995988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:44.996468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:44.996930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:44.997639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:44.998085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:44.998510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:45.145730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:45.155632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-62b23622-7afb-47f8-bcbe-fc1f3f3a0600 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171102 Oct 19 13:30:45.156517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 818/1565] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:45.276415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:45.278911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:45.286824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:45.287307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:45.287746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:45.288455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:45.289029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:45.289402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:45.329004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-db78a414-5ecf-409c-8e0b-055834bdc195 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058442 Oct 19 13:30:45.329584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 748/1566] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:46.182316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:46.183017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:46.193183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:46.194060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:46.194811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:46.196075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:46.196806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:46.197770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:46.344123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:46.346661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:46.356139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:46.357031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:46.357743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:46.358987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:46.359845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:46.360274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:46.409768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:46.412052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6128f81a-347a-4567-8b56-9900c054e4d0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072082 Oct 19 13:30:46.412644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 749/1567] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:46.423089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28d0a764-5d38-4256-94ae-74522deed57b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.244954 Oct 19 13:30:46.423776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 819/1568] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:46 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:47.426242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:47.428759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:47.435215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:47.435697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:47.436122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:47.436835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:47.437315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:47.437721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:47.449537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:47.450761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:47.459500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:47.468114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:47.468114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:47.468114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:47.468114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:47.468627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:47.480695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6c9a412b-ef4f-4b2b-8fe4-5fab0717a35a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058738 Oct 19 13:30:47.481335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 750/1569] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:47.620182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:47.629663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c9d9be6-7e1c-436b-9936-b837dc1951ab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.185104 Oct 19 13:30:47.630274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 820/1570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:47 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:48.494557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:48.497352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:48.505254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:48.505733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:48.506153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:48.506833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:48.507270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:48.507819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:48.545627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-95e75e1c-6296-449c-97d3-cbbe1fe9dd40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055528 Oct 19 13:30:48.546232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 751/1571] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:48.655357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:48.655940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:48.662716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:48.663176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:48.663603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:48.664578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:48.665434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:48.666121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:48.692401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:48.840412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:48.849333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-799d58ee-6ad3-4621-9266-c7f9f469dd63 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.197595 Oct 19 13:30:48.849944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 821/1572] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:48 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:49.558953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:49.562089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:49.569249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:49.569654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:49.570457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:49.571436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:49.572186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:49.572904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:49.619597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7105e6f9-3291-442d-9484-e2029460d273 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064920 Oct 19 13:30:49.620177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 752/1573] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:49.874567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:49.875496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:49.882544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:49.883285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:49.883941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:49.884323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:49.884779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:49.885222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:50.058747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:50.068095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-abfaa31e-fc1c-4c04-9ccf-5d3a84785853 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.198324 Oct 19 13:30:50.068737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 822/1574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:49 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:50.633042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:50.635884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:50.642615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:50.643099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:50.643524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:50.644226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:50.644668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:50.645117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:50.682788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9a52426f-acab-4a31-80be-609237228cc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054451 Oct 19 13:30:50.683383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 753/1575] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:51.095922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:51.096845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:51.105150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:51.105755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:51.106394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:51.107600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:51.108223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:51.108959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:51.290974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:51.300090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-477f697c-d9dd-4117-9b7e-c09e2282a3c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.208267 Oct 19 13:30:51.300750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 823/1576] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:51.698604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:51.701895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:51.709239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:51.709632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:51.710052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:51.710748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:51.711172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:51.711586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:51.747778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8391e9a4-89f9-4c70-a667-4410b8c01d1b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053573 Oct 19 13:30:51.748350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 754/1577] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:52.325175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:52.325822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:52.333552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.334035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.334470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.335220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.335656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.336099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.487208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:52.496632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-681781ad-aebf-4eb3-a7d9-e2b4e158d47a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175585 Oct 19 13:30:52.497252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 824/1578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:52 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:52.757675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:52.758243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:52.761385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:52.764312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:52.765982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.766733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.767232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.768120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.768577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.769044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.771127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.772778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.773319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.775841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.775841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.775841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.813179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7be6ad47-ef86-444d-86c3-af67d582d5c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057045 Oct 19 13:30:52.814075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 825/1579] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:52.815341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:30:52.920414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e4312a0e-ff10-42c5-bcf9-0c98cc047094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 204 len: 0 microversion: 2.20 time: 0.167914 Oct 19 13:30:52.921206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 755/1580] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Oct 19 13:30:52 2022] DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 13:30:52.933720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:52.934682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:52.942200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.942578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.943011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:52.943721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:52.944171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:52.944596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:53.099644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:53.112715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:53.114254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:53.115505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dd26983f-b617-4e69-8b3d-441e8f89232b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1800 microversion: 2.20 time: 0.189167 Oct 19 13:30:53.116120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 826/1581] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1800 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:53.521771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:53.522468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:53.529598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:53.530102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:53.530708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:53.531410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:53.531850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:53.532261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:53.770322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:53.781579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-21afd83d-9e05-411d-9446-606c51367702 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.263991 Oct 19 13:30:53.782440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 756/1582] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:53 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:53.829774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:53.832057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:53.840923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:53.841435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:53.841877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:53.842607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:53.843067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:53.843499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:53.888812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f67d696-42ce-4b2c-8bea-2a7bba11fc9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063300 Oct 19 13:30:53.889682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 827/1583] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:54.143585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:54.144290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:54.151661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.152170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.152689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.153482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.153859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.154394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.302192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:54.304788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:30:54.320465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:54.322126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:54.323308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa5719e1-158e-4541-8e19-400d743cebcb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1800 microversion: 2.20 time: 0.184230 Oct 19 13:30:54.323861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 757/1584] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:54.732352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26717ab1-6c97-4d22-afe6-d00760711621", "name": "network-vif-deleted", "tag": "c368e5fe-cf2d-48e4-a146-d659de191a82"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:30:54.744448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.744973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.745605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.759422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] Creating event network-vif-deleted:c368e5fe-cf2d-48e4-a146-d659de191a82 for instance 26717ab1-6c97-4d22-afe6-d00760711621 on hv-cinder-maste Oct 19 13:30:54.766130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-c84dcfe5-62a0-4bde-875b-ebfc60f3ac55 req-f20baf22-6dee-430f-afc5-196dff72403b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108554 Oct 19 13:30:54.767984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 828/1585] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:54.809231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:54.810126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:54.818148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.818672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.819176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.819888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.821129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.821129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.908206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:54.912162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:54.929201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.929673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.930729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.931135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:54.931985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:54.932753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:54.974628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3721cf05-302e-4f03-b35a-80445e5673c9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074244 Oct 19 13:30:54.975474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 829/1586] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:54.991965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:55.001939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-44ccec4d-d367-46c4-bb3e-4b81baf8e1a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.197330 Oct 19 13:30:55.001939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 758/1587] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:54 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:55.351612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:55.352666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:55.363409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:55.364510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:55.365218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:55.367972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:55.368538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:55.369000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:55.452020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:55.463656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:55.465131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:55.466402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ea4fbc62-6234-4370-a81d-63f7c95dbb96 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.120770 Oct 19 13:30:55.467293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 830/1588] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:55.988144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:55.990748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:55.998357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:55.999147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:55.999579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.000291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:56.000738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:56.001187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.030012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:56.030648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:56.037796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ed5109d6-7176-44da-a5c4-e1911af03f03 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053775 Oct 19 13:30:56.038365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 759/1589] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:56.040468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:56.041043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:56.041672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.043592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:56.044044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:56.044477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.198948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:56.209275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f9428655-f0c1-4fe6-b0f4-f2f94d05f63a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182671 Oct 19 13:30:56.209948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 831/1590] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:30:56.494296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:56.495271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:56.501767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:56.502241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:56.503019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.503745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:56.504183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:56.504614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:56.569673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:56.579542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:56.581492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:56.582695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-be49ea20-c59b-4d71-8fd6-92ccb9e04011 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092782 Oct 19 13:30:56.583284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 760/1591] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:57.122135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:57.124420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:57.131175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.131666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.132126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.132822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.133310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.133883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.166072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ab852d0-658d-45fa-bda7-0be10d09e885 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117766 Oct 19 13:30:57.166664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 832/1592] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:57.233971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:57.234621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:57.241988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.242466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.242962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.243673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.244319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.245036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.395845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:57.404761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e6fcd21a-4ed3-4152-b06f-567bb7386678 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174974 Oct 19 13:30:57.405399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 761/1593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:57.608396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:57.608963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:57.615892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.616379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.616811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.617560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:57.618025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:57.618617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:57.689043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:57.698645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:57.700143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:57.701405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-004cc74c-3183-4307-a200-b800a111c754 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097092 Oct 19 13:30:57.701952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 833/1594] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:58.179150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:58.182413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:58.188398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.188965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.189342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.190079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.190522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.190938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.223159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-21bd5207-9dbd-452e-97bc-2d28898fed07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Oct 19 13:30:58.223703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 762/1595] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:58.430270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:58.431223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:58.440736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.440736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.440736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.440736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.441559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.441559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.599910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:58.609679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aeb41683-f216-404c-9ee8-17c1b0f31e65 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183896 Oct 19 13:30:58.610265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 834/1596] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:58 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:58.726777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:58.727406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:58.734655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.735123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.735547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.736241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:58.736677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:58.737122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:58.804829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:58.814553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:58.816111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:58.817268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7d778bf3-1626-4f96-bcc3-5f988cb71837 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094560 Oct 19 13:30:58.817822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 763/1597] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:30:59.236125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:59.238563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:59.245374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.245880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.246329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.247029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.247476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.247897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.279235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ee3fc76-f9fa-4447-b8ce-2c446e8fa281 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Oct 19 13:30:59.280075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 835/1598] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:30:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:30:59.637589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:59.638632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:59.647721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.648381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.649145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.650135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.650742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.651248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.811462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:59.822605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f2c89993-bfee-48c7-bef9-d42b23ec2d1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.191992 Oct 19 13:30:59.826793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 764/1599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:30:59 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:30:59.844058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:30:59.846752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:30:59.851858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.852348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.852901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.853751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:30:59.854302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:30:59.854723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:30:59.923213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:59.933061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:59.934900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:30:59.935805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c4734cc-cb42-4cfd-9c56-db49e2effdcf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096264 Oct 19 13:30:59.936305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 836/1600] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:30:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:31:00.292303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:00.294937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:00.302081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.302574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.302995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:00.303697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.304145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.304565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:00.340891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-54f9eb1c-f57f-4293-b5a8-801e37202790 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052727 Oct 19 13:31:00.341598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 765/1601] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:00.847087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:00.847687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:00.855050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.855534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.856043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:00.856812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.857300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.857716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:00.962314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:00.963328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:00.970661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.971270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.971700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:00.972601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:00.973260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:00.973737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:01.009003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:01.018609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3b25b682-7c39-4b95-8c2e-98046b895701 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175641 Oct 19 13:31:01.019267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 837/1602] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:01.049485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:01.059645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:01.061123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:01.062370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b6c4f30d-3b60-40dd-aabf-b9b1f366785b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104662 Oct 19 13:31:01.062861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 766/1603] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:31:01.354740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:01.356989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:01.363552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:01.364081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:01.366310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:01.367027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:01.367480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:01.367906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:01.395334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:01.403847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1fb1d61c-71d4-41e4-9de1-45141e018ab1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053708 Oct 19 13:31:01.404439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 838/1604] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:02.045442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:02.046696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:02.056580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.057355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.057778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.058502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.058980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.059422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.088847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:02.091354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:02.098694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.099480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.100120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.101324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.101961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.102554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.177832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:02.187954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:02.189751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:02.191673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c4524055-b667-4ecf-93ec-2f15c321a0f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.107002 Oct 19 13:31:02.199648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 839/1605] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:02.221394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:02.230765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4e64e463-d571-4f80-83c6-6c6d5bd9338a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.190761 Oct 19 13:31:02.231349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 767/1606] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:02.416252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:02.418623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:02.424796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.425473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.425912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.426647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:02.427087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:02.427615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:02.459640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e2ed52bb-99e7-40f8-bb4e-002f7f753e9d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Oct 19 13:31:02.460201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 840/1607] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:03.224400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:03.225089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:03.232148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.232602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.233066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.233763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.234199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.234611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.256709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:03.257580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:03.264243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.265055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.265690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.266678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.267328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.267980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.303072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:03.312849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:03.314413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:03.315792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0c0743a2-876c-4e2b-b7a6-1c1a54ed39cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095595 Oct 19 13:31:03.316665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 768/1608] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:03.407140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:03.416183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-65cac5f2-8e4b-4272-9140-e1061b578f9e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164281 Oct 19 13:31:03.416757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 841/1609] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:03 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:31:03.477093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:03.479908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:03.487632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.488408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.489022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.490213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:03.490971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:03.491688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:03.524922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ef8d134-466a-45e2-a9d4-41b8da27ee1c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054998 Oct 19 13:31:03.525918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 769/1610] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:04.343433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:04.344045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:04.352128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.352616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.353140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.353967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.354429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.355064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.421926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:04.431336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:04.432779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:04.433960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f605e51a-c625-4fcc-ade2-a429a88f4c5e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094725 Oct 19 13:31:04.434628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 842/1611] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:04.439839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:04.440564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:04.447414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.447926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.448351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.449079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.449515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.449922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.538143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:04.540350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:04.547227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.547711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.548142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.548890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:04.549329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:04.549755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:04.581895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7dce9bb0-5ddc-43ca-b251-f0ded2d01e8e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047624 Oct 19 13:31:04.582688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 843/1612] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:04.591377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:04.602290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4fb6a690-49da-4e65-9f2f-fd82b8df8af4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165961 Oct 19 13:31:04.603045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 770/1613] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:05.459311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:05.459931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:05.467919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.468410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.468852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.469572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.470017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.470436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.534981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:05.545269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:05.546778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:05.547861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9545ca4a-9009-45b0-958e-4169fe2c43b0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092645 Oct 19 13:31:05.548433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 844/1614] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:05.599328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:05.602697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:05.610801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.611601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.611815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.612438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.612909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.613335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.647048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e378176a-b9f8-44ac-902e-230d477564bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054346 Oct 19 13:31:05.647799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 771/1615] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:05.682062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:05.682827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:05.689779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.690272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.690696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.691422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:05.691875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:05.692290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:05.858903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:05.867277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ee618b5b-e919-4c01-98d9-f74214d882da tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.245792 Oct 19 13:31:05.867826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 845/1616] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:06.576185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:06.576916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:06.585872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.586512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.587118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:06.588471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.588855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.589316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:06.660740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:06.661416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:06.663118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:06.670658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.671148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.671571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:06.671979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:06.672273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.673231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.673878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:06.674350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:06.675534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8d55916d-5711-4a62-befe-ce7c5c3a1362 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105447 Oct 19 13:31:06.676667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 772/1617] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:06.707167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d4aef5eb-51c0-487e-be01-a584f7ea7095 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051170 Oct 19 13:31:06.707730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 846/1618] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:06.892535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:06.893270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:06.901223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.902220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.902731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:06.903671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:06.904311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:06.905002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:07.057452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:07.071232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-04a5be61-6ae1-48e6-9644-ccbbf8100829 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183028 Oct 19 13:31:07.072107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 773/1619] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:06 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:07.701835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:07.702394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:07.709911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:07.710365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:07.710796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:07.711491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:07.711933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:07.712350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:07.719984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:07.722252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:07.728849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:07.729558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:07.730023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:07.730731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:07.731179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:07.731596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:07.746012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:07.764495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af894f0a-cd9d-470c-9302-9fdcdd4f9186 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Oct 19 13:31:07.765480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 774/1620] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:07.776853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:07.786287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:07.787718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:07.788893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0a2412c7-1fe8-4404-9c1d-102a077f7679 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091183 Oct 19 13:31:07.789431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 847/1621] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:08.097346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:08.098018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:08.104890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.105382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.105815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.106537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.107005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.107429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.254987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:08.263782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3d435046-79c6-4f9f-a48f-bf137a7952dc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171372 Oct 19 13:31:08.264635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 775/1622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:08.778519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:08.780922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:08.788485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.789033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.789490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.790227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.790715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.791162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.820470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:08.821186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:08.821786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-360be999-13ff-48a4-9114-78e0ed4b0fb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Oct 19 13:31:08.822333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 848/1623] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:08.828754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.829256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.829683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.830375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:08.830814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:08.831231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:08.896563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:08.905743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:08.907172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:08.908296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ce6832b3-bbab-45d2-a23a-0aed8a93be89 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091775 Oct 19 13:31:08.908843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 776/1624] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:09.290696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:09.291510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:09.300662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.301371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.301887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:09.302938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.303524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.304115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:09.451029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:09.459725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f454c48b-583c-41c3-a740-87234681c079 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175378 Oct 19 13:31:09.460300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 849/1625] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:09 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:09.836786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:09.839610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:09.846974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.847454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.847874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:09.848725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.849307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.849721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:09.884306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2988d30c-0774-41f8-8203-235de9f5f9ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051672 Oct 19 13:31:09.884851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 777/1626] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:09.935294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:09.935897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:09.942678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.943172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.943608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:09.944335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:09.944823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:09.945253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:10.013027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:10.022449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:10.023870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:10.025043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7ba5cad3-52ac-4d32-8e08-8bfc22256df3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094784 Oct 19 13:31:10.025687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 850/1627] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:10.484826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:10.485454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:10.493396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:10.494049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:10.494685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:10.496083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:10.496651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:10.497228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:10.652211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:10.661204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0adc7ed4-9332-4864-bfea-2af05462c252 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180265 Oct 19 13:31:10.661785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 778/1628] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:10.900068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:10.902864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:10.911489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:10.912119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:10.912700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:10.913656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:10.914254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:10.914815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:10.947494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0c72055b-9efe-40e1-8533-8cc8cac5a32f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052848 Oct 19 13:31:10.948184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 851/1629] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:11.052608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:11.053271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:11.060141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.060616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.061077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:11.061762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.062206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.062621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:11.138485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:11.148592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:11.150061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:11.151271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e7dacdde-bbec-488d-9c83-2f90eb0ddde2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102630 Oct 19 13:31:11.151758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 779/1630] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:11.696758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:11.697813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:11.700475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=74 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:11.707375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.707856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.708285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:11.709005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.709449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.709866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:11.853323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:11.862430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b46e0553-188e-4406-849a-167eb504ef97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171822 Oct 19 13:31:11.863010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 852/1631] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:11.964818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:11.968190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:11.975959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.976444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.976886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:11.977612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:11.978065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:11.978484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:12.010006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fed2d339-785e-45f9-b807-24251ba7835f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052077 Oct 19 13:31:12.010552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 780/1632] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:31:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:31:12.177402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:12.177978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:12.184846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:12.185484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:12.185926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:12.186619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:12.187070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:12.187492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:12.254366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:12.263846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:12.265330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:12.266494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3706ae44-f1f7-4083-a354-4e15a441eb2a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093436 Oct 19 13:31:12.267114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 853/1633] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:12.888250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:12.889013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:12.898299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:12.898917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:12.899474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:12.900769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:12.901452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:12.902006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:13.022273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:31:13.024595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:13.031110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:13.031577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:13.032020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:13.032714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:13.033196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:13.033613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:13.043303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:13.051887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12f45ceb-eb8a-42bc-9f7f-ad798fb3c6c9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168555 Oct 19 13:31:13.052473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 781/1634] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:13.112083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-933eee2c-0f69-4a55-b0dc-8d19e8e80d6c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action" status: 200 len: 76038 microversion: 2.1 time: 0.093458 Oct 19 13:31:13.112768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 854/1635] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 13:31:13 2022] POST /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a/action => generated 76038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 13:31:13.298884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:13.299504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:13.305994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:13.306474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:13.306905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:13.307593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:13.308039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:13.308453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:13.372644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:13.382137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:13.383559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:13.384680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0215601b-df95-40d5-854f-d5b424bf71ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090590 Oct 19 13:31:13.385280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 782/1636] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:14.080750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:14.081596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:14.090148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:14.090718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:14.091198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:14.091964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:14.092450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:14.092950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:14.239263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:14.241610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:14.249301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f3b3af9-e8e5-42f1-ad70-7d89635d3bb3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175761 Oct 19 13:31:14.249880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 855/1637] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:14 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:14.412629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:14.413373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:14.416010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:14.422554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:14.423121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:14.423869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:14.424809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:14.425343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:14.425848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:14.491118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:14.500439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:14.502561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:14.503747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fbacd080-8b9a-4375-a4d3-3986d8d24b74 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096268 Oct 19 13:31:14.504303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 783/1638] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:15.274791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:15.275453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:15.285882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:15.286388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:15.286839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:15.287886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:15.288054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:15.288460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:15.450897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:15.459710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7995e853-4386-4670-8ea9-7532108ee74a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.189183 Oct 19 13:31:15.460301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 856/1639] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:15 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:31:15.529979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:15.530563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:15.538495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:15.538970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:15.539398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:15.540087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:15.540528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:15.540960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:15.613477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:15.622982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:15.624401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:15.625573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-60d836ed-5fbe-444e-9057-2b1d22e7990a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099722 Oct 19 13:31:15.626123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 784/1640] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:16.490904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:16.491675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:16.499506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:16.500014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:16.500445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:16.501206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:16.501721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:16.502422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:16.648553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:16.652472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:16.653104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:16.657549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c625e9ab-de38-4ff3-8539-32d0ec52a66b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171234 Oct 19 13:31:16.658127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 857/1641] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:16.659884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:16.660368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:16.660795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:16.661518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:16.661963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:16.662376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:16.729884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:16.739117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:16.740541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:16.741722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-de29e0ab-6830-47ff-a922-802f41e209c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093889 Oct 19 13:31:16.742362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 785/1642] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:17.682523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:17.683098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:17.690347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:17.690835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:17.691298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:17.692012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:17.692455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:17.692893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:17.767216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:17.767989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:17.774697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:17.775204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:17.775597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:17.776313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:17.776726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:17.777166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:17.841325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:17.846696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:17.850847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6ad7e749-3a70-4b41-980a-4c871c50f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172996 Oct 19 13:31:17.851576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 858/1643] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:17.855894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:17.857446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:17.858653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6b3ebe82-4558-460f-bc68-a36df43e5cc5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095616 Oct 19 13:31:17.859265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 786/1644] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:18.875498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:18.876147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:18.884139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:18.884713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:18.884713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:18.884964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:18.885157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:18.885843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:18.886292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:18.886708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:18.891567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:18.892066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:18.892736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:18.893464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:18.893909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:18.894319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:18.959356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:18.969570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:18.970991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:18.972172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0c7ac2f0-5bc6-4d04-9503-aa95cccd56df tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092033 Oct 19 13:31:18.974543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 787/1645] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:19.026944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:19.035902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-086970bd-ec9c-44c1-b822-11fdd1b95da9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164353 Oct 19 13:31:19.036481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 859/1646] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:19.999000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:19.999635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:20.007136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:20.007621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:20.008031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:20.008786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:20.009390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:20.009807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:20.059435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:20.060058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:20.067119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:20.067613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:20.068052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:20.068760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:20.069249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:20.070379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:20.072678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:20.081802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:20.083247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:20.084402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8a1354e-cd0a-419b-a112-5fbab4424e20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089425 Oct 19 13:31:20.085087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 788/1647] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:20.209755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:20.221767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-58490b2c-3520-4cc3-984d-001287c33811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166016 Oct 19 13:31:20.222638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 860/1648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:20 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:21.114699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:21.115341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:21.123066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:21.123543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:21.123970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:21.124649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:21.125125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:21.125540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:21.200947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:21.213510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:21.214955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:21.216106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dc82b76e-6bef-49dc-83d1-6db30839c960 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.107694 Oct 19 13:31:21.216668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 789/1649] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:21.247556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:21.248130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:21.255482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:21.255974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:21.256415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:21.257146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:21.257641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:21.258175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:21.394606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:21.403659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9634aa82-dce5-41b2-9686-e6f849598ea4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159986 Oct 19 13:31:21.404232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 861/1650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:22.251712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:22.252900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:22.261290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:22.261767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:22.262166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:22.262891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:22.263329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:22.263740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:22.327865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:22.336750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:22.338227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:22.339368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-954cf3eb-f0e4-41ce-a0de-c05accf6ca35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092976 Oct 19 13:31:22.339919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 790/1651] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:31:22.429841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:22.431015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:22.440230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:22.440916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:22.441550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:22.442499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:22.443198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:22.443811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:22.593829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:22.607262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9c1b2529-91ff-4e3f-945e-9288c874b24d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182489 Oct 19 13:31:22.608064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 862/1652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:22 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:23.364577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:23.365191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:23.372176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:23.372649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:23.373105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:23.373791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:23.374236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:23.374646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:23.377548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:23.446080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:23.455965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:23.457451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:23.458606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-68c9ba70-700e-4c7e-b01f-35dd799a39f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098023 Oct 19 13:31:23.459173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 791/1653] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:23.638843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:23.639695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:23.650645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:23.651127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:23.651679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:23.652381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:23.652831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:23.653285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:23.788231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:23.796711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-07d441d7-91a8-45a2-b0f0-c68064868c84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164709 Oct 19 13:31:23.797602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 863/1654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:24.484823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:24.485452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:24.492326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:24.492835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:24.493287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:24.494025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:24.494557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:24.494978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:24.558040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:24.567015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:24.568358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:24.569520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b51c26a7-7e58-4394-9efd-7a2f1acf4202 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088834 Oct 19 13:31:24.570074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 792/1655] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:24.824559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:24.825328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:24.835434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:24.836168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:24.836828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:24.837937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:24.838652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:24.839082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:24.998793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:25.009501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c81663a0-b5eb-4195-a5db-68a48c4fd6e3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.191314 Oct 19 13:31:25.010094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 864/1656] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:25.606590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:25.607155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:25.614155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:25.614634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:25.615059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:25.615745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:25.616211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:25.616622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:25.695308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:25.704730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:25.706186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:25.707317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f49c9ad5-a20f-4173-8745-07174f1bfc31 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104834 Oct 19 13:31:25.707873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 793/1657] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:26.037140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:26.038125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:26.046560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:26.047045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:26.047475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:26.048167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:26.048618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:26.049079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:26.192588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:26.201167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1b2e85ea-8c97-4c81-8eea-c29d0672f31e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170612 Oct 19 13:31:26.201746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 865/1658] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:26.732383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:26.732984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:26.739971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:26.740446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:26.740892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:26.741598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:26.742046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:26.742458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:26.810911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:26.821140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:26.823038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:26.824520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b4263706-e63d-4fe0-b54b-7a838203944a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096072 Oct 19 13:31:26.825363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 794/1659] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:27.227323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:27.228265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:27.238855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:27.239595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:27.240262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:27.241395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:27.242107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:27.242760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:27.381749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:27.390618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-22549503-55b7-41be-9266-8046eb8520bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169669 Oct 19 13:31:27.391184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 866/1660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:27.854099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:27.854963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:27.866096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:27.866878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:27.867588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:27.868711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:27.869609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:27.870037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:27.936780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:27.945567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:27.946979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:27.948327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-264d9299-979a-409c-9047-fc6f305d1d99 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100833 Oct 19 13:31:27.949052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 795/1661] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:28.415079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:28.415655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:28.423192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:28.423676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:28.424107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:28.424806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:28.425302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:28.425720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:28.567834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:28.576613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-186133d0-ffda-46b3-b6a6-e5d14f87b407 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165521 Oct 19 13:31:28.577224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 867/1662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:28 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:28.980703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:28.981309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:28.988211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:28.988685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:28.989141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:28.989835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:28.990274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:28.990689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:29.061052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:29.073809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:29.075257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:29.076408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-13e86a9a-6d69-4b75-a135-692df2db2233 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100266 Oct 19 13:31:29.076989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 796/1663] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:29.599914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:29.600622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:29.608180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:29.608668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:29.609132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:29.609837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:29.610288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:29.610713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:29.743633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:29.757502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-352a9e36-3aea-4127-aa17-4485dcfac808 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161230 Oct 19 13:31:29.758465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 868/1664] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:30.105812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:30.106676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:30.116929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:30.117706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:30.118354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:30.119401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:30.120218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:30.120683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:30.193531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:30.202443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:30.203984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:30.205174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8472131-8e14-4b87-92f4-08e053bc27f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105826 Oct 19 13:31:30.205728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 797/1665] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:30.783085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:30.783715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:30.790705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:30.791191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:30.791656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:30.792455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:30.792983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:30.793413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:30.931911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:30.940786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-573a6b1f-0066-4c07-bb08-9a5b6af92895 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161672 Oct 19 13:31:30.941424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 869/1666] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:30 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:31.232992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:31.233659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:31.240551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:31.241063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:31.241492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:31.242173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:31.242627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:31.243034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:31.311221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:31.320313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:31.321781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:31.322939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8908788e-18c4-4ca1-a8b8-4e9159caa650 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095175 Oct 19 13:31:31.323497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 798/1667] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:31.977437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:31.978321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:31.986164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:31.986643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:31.987070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:31.987757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:31.988202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:31.988620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:32.123076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:32.132117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-586e735e-53b3-4f1f-a74d-429ee5e537ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161257 Oct 19 13:31:32.132692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 870/1668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:32.351762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:32.352661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:32.362858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:32.363541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:32.364143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:32.365190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:32.365774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:32.366377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:32.437712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:32.451035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:32.453233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:32.454973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cbdf8e7a-8dc0-4967-b8e3-91a6ce1c18ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.109290 Oct 19 13:31:32.455748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 799/1669] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:33.157523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:33.158239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:33.166300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:33.166872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:33.167395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:33.168257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:33.168797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:33.169332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:33.324064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:33.337247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cc256df0-8ce2-40df-8252-06a30524b1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.184484 Oct 19 13:31:33.337961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 871/1670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:33 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:33.482245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:33.482813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:33.489926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:33.490402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:33.490822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:33.491507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:33.491941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:33.492348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:33.555346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:33.564384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:33.565921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:33.567047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2cb7acdd-9d39-48af-bb30-0e332e8a433a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088975 Oct 19 13:31:33.567593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 800/1671] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:34.365553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:34.366175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:34.373206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:34.373723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:34.374165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:34.374901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:34.375771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:34.375959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:34.392784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:34.519364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:34.528345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6bccda3e-7021-4a4d-9a13-4fdb6e9ef08a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166945 Oct 19 13:31:34.528919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 872/1672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:34 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:34.592143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:34.592764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:34.600488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:34.600999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:34.601421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:34.602108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:34.602545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:34.602962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:34.672634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:34.682203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:34.683616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:34.684758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eeaa39f2-939b-4079-b96a-ae334216cad0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096738 Oct 19 13:31:34.685308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 801/1673] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:35.553960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:35.554665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:35.563029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:35.563594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:35.564106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:35.564912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:35.565474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:35.565968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:35.708510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:35.715698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:35.716369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:35.717960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5fec0e9d-510c-4166-a32c-ecc1ab145656 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168605 Oct 19 13:31:35.718574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 873/1674] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:35.723677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:35.724150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:35.724572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:35.725287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:35.725725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:35.726131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:35.801228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:35.810238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:35.811688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:35.812827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1e6417c2-3a52-4adf-87d2-a3969a001e1b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101035 Oct 19 13:31:35.813376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 802/1675] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:36.743163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:36.743758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:36.751296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:36.752124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:36.752548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:36.753322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:36.753770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:36.754202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:36.840701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:36.841304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:36.848695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:36.849214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:36.849640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:36.850331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:36.850771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:36.851185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:36.899300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:36.909111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4987d9f8-1002-4d1e-9617-238437126833 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170279 Oct 19 13:31:36.909732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 874/1676] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:36 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:36.915243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:36.924721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:36.926195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:36.927364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d230dc02-0dd4-498b-bdfe-42c4ea7f04a3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093005 Oct 19 13:31:36.927918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 803/1677] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:37.933312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:37.933983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:37.941634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:37.942146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:37.942568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:37.943269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:37.943715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:37.944132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:37.955810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:37.957129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:37.965612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:37.966376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:37.967037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:37.968007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:37.969068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:37.969547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:38.040482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:38.059221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:38.061688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:38.063736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8b5fcc53-3742-4640-bc5c-91a83731ad42 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.112245 Oct 19 13:31:38.064766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 804/1678] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:38.103695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:38.112561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-85c36f9e-50ca-4ed7-a1bc-69b08cd6542e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183033 Oct 19 13:31:38.113197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 875/1679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:39.094169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:39.094800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:39.101464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:39.101951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:39.102385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:39.103080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:39.103549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:39.103940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:39.136151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:39.136842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:39.144235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:39.144772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:39.145236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:39.145948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:39.146399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:39.146826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:39.176798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:39.186322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:39.187822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:39.189170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-47c800bd-1ad7-4043-a105-cc9a0b62f21d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101838 Oct 19 13:31:39.190062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 805/1680] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:39.320621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:39.329297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b0c26aa1-4154-41d7-ac5f-8c333142ddc4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.196996 Oct 19 13:31:39.329879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 876/1681] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:39 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:40.217350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:40.217968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:40.224982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:40.225483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:40.225893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:40.226591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:40.227026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:40.227434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:40.293613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:40.303404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:40.304815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:40.305982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9fbb867c-59fe-4ec8-bfe0-0a84c1929dca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094143 Oct 19 13:31:40.306706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 806/1682] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:40.353965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:40.354868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:40.362747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:40.363211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:40.363666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:40.364368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:40.364848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:40.365295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:40.522321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:40.531475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6f16b19e-59fe-4e45-a2dd-dae4e26f3a14 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.181652 Oct 19 13:31:40.532206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 877/1683] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:40 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:41.332365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:41.333022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:41.341467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:41.342111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:41.342945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:41.343956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:41.344581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:41.345308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:41.429329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:41.431736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:41.440002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:41.441546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:41.442769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c0351538-44b3-41bf-8627-8ec668e48276 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.114543 Oct 19 13:31:41.443428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 807/1684] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:41.556179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:41.557155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:41.564478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:41.564910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:41.565354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:41.566072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:41.566526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:41.566966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:41.720375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:41.730145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1e16edb9-9d93-48fa-925f-31c0483af11e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.178003 Oct 19 13:31:41.730753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 878/1685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:41 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:42.470575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:42.471031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:42.481895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:42.482738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:42.483480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:42.484808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:42.485687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:42.486388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:42.569253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:42.578955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:42.580451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:42.581656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12973329-4c31-4b0a-8c3f-dcdf1533ed58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.117399 Oct 19 13:31:42.582224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 808/1686] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:42.765745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:42.766657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:42.770278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=54 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:42.778567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:42.779335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:42.780042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:42.781272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:42.781998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:42.782669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:43.008375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:43.018911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d3f266f6-1ba3-4748-86bf-d93718a94163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.259926 Oct 19 13:31:43.019497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 879/1687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:42 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:43.612425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:43.613025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:43.620896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:43.621492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:43.621923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:43.622619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:43.623088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:43.623632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:43.697259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:43.706551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:43.707978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:43.709267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a5f661a0-34dd-46a7-8a92-bf5cf08bd629 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102107 Oct 19 13:31:43.709838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 809/1688] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:44.042890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:44.043536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:44.051204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:44.051690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:44.052116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:44.052827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:44.053307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:44.053726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:44.204675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:44.213958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-48849981-5bbb-46ec-bb37-82a8fd1522f4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174941 Oct 19 13:31:44.214572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 880/1689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:44.735947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:44.736727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:44.738911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=54 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:44.744707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:44.745222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:44.745649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:44.746354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:44.746796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:44.747208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:44.827233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:44.836555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:44.838021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:44.839168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e36b6d19-955f-4149-b662-26a847353922 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.107634 Oct 19 13:31:44.839737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 810/1690] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:45.257927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:45.258880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:45.267758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:45.268553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:45.269098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:45.269821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:45.270276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:45.270725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:45.430172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:45.440231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e453abd4-b68a-48e4-9988-6f25ab1c9124 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188818 Oct 19 13:31:45.440801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 881/1691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:45 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:45.866238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:45.866841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:45.874120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:45.874879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:45.875072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:45.875754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:45.876226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:45.877091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:45.944319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:45.954441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:45.956222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:45.957483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4e3c3aba-cd74-4a07-acbc-5b05d863244a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095323 Oct 19 13:31:45.958093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 811/1692] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:46.470780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:46.471419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:46.478314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:46.478810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:46.479239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:46.479927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:46.480374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:46.480796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:46.627535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:46.636029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-892841ac-6087-47e4-b7ef-2368b419f877 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172346 Oct 19 13:31:46.636601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 882/1693] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:46 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:46.987982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:46.988787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:46.998708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:46.999456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:47.000180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:47.001722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:47.002367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:47.003059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:47.084054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:47.095287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:47.097204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:47.098015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-326364cf-ede7-4b6f-a2d7-5c76ba699746 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.116917 Oct 19 13:31:47.098582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 812/1694] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:47.660208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:47.660798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:47.667917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:47.668409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:47.668848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:47.669590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:47.670052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:47.670480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:47.820814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:47.830002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3c14e3e5-6a33-44dd-ad23-55beeaff8f0d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173965 Oct 19 13:31:47.830626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 883/1695] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:47 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:48.124607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:48.125433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:48.133115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:48.133584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:48.134041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:48.134730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:48.135176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:48.135596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:48.218509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:48.227901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:48.229347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:48.230538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-426f47a7-a519-442e-8679-eb96dbc8ce3c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110312 Oct 19 13:31:48.231098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 813/1696] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:48.853710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:48.854330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:48.861772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:48.862265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:48.862708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:48.863518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:48.864011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:48.864542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:49.009463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:49.018778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c957b4de-f502-494f-8161-00ecf6a6cfc9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169027 Oct 19 13:31:49.019768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 884/1697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:48 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:49.256744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:49.257390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:49.264421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:49.264901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:49.265481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:49.266189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:49.266635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:49.267059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:49.337981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:49.351454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:49.354022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:49.355975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8ef7e7f7-7f85-40fb-95c6-40dacc639a35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103171 Oct 19 13:31:49.356853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 814/1698] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:50.043934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:50.044569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:50.052461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:50.053013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:50.053450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:50.054167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:50.054620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:50.055042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:50.214378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:50.223905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b38178dd-9b70-4002-bb19-128b01298e57 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183920 Oct 19 13:31:50.224489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 885/1699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:50 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:50.398672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:50.399280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:50.406295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:50.406781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:50.407207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:50.407947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:50.408378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:50.408790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:50.475609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:50.490747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:50.493276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:50.495327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8b11f47e-28f9-457d-bdc6-8a279b8cdc0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102587 Oct 19 13:31:50.496198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 815/1700] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:31:51.246825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:51.247474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:51.255184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:51.255680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:51.256118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:51.256887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:51.257332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:51.257787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:51.413087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:51.422099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28460d51-cfe5-4579-88eb-763eeaeb6bbb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.179220 Oct 19 13:31:51.422712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 886/1701] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:51.525043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:51.525672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:51.532725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:51.533264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:51.533694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:51.534387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:51.534821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:51.535236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:51.601405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:51.611337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:51.612829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:51.614217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1b7bcf4d-fd1a-4aba-b27a-b990779aa505 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093471 Oct 19 13:31:51.614778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 816/1702] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:52.446253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:52.446930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:52.454761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:52.455251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:52.455692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:52.456412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:52.456854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:52.457312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:52.627437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:52.636537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f987db71-7857-4902-b1a9-154358d40c92 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.194247 Oct 19 13:31:52.637186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 887/1703] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:52 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:52.641410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:52.642016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:52.649870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:52.650551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:52.650979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:52.651691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:52.652145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:52.652554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:52.726383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:52.736363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:52.737840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:52.738991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eda6e609-5e75-4131-831d-a87cf74985ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101813 Oct 19 13:31:52.739557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 817/1704] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:53.661298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:53.661881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:53.668694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:53.669210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:53.669644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:53.670333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:53.670785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:53.671205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:53.763927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:53.764616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:53.772296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:53.772774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:53.773231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:53.773923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:53.774362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:53.774814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:53.821128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:53.831862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9ad726bc-e10d-498e-bb53-71b298b8d44a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174661 Oct 19 13:31:53.832449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 888/1705] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:53 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:54.049956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:54.059158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:54.060579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:54.061749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9fce9813-0f70-482d-ad11-7a095b9f66c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.301872 Oct 19 13:31:54.062745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 818/1706] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:54.860555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:54.861502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:54.872412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:54.873286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:54.874000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:54.875218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:54.875860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:54.876634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:54.879440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:31:55.019777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:55.028128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-297c4da0-22cb-464e-97b1-eae5f6d26b56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174738 Oct 19 13:31:55.028710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 889/1707] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:54 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:55.090657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:55.091578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:55.099925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:55.100407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:55.100831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:55.101549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:55.101987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:55.102396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:55.173810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:55.183744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:55.185251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:55.186419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d37365b7-3cd7-4406-82ac-a0303047f5ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101625 Oct 19 13:31:55.187492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 819/1708] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:56.052327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:56.053010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:56.060804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:56.061324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:56.061759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:56.062447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:56.062939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:56.063361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:56.214010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:56.215545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:56.224049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:56.224049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:56.224360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:56.225079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:56.225542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:56.225963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:56.236294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:56.247429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-760f04d8-5554-419d-8bbf-e485e23b8163 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.199011 Oct 19 13:31:56.248029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 890/1709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:56.306022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:56.315925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:56.317399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:56.318562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a782b674-00fa-4954-ba97-8c748ee49b7d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.108964 Oct 19 13:31:56.319128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 820/1710] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:57.272842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:57.273517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:57.280410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:57.280892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:57.281348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:57.282192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:57.282648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:57.283069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:57.344092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:57.344807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:57.351972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:57.352445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:57.353447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:57.353571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:57.354032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:57.354449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:57.425229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:57.428250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:57.436151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:57.436730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e3db9b0b-9291-48f9-b40a-eb4fe69156ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167816 Oct 19 13:31:57.437347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 891/1711] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:57.437895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:57.439123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a871db5d-515e-4aeb-9d34-1152594dbf6e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099266 Oct 19 13:31:57.439745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 821/1712] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:58.461132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:58.462162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:58.470199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:58.470884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:58.471355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:58.472198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:58.472560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:58.472646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:58.472732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:58.473057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:58.480821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:58.481331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:58.481754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:58.482428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:58.482866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:58.483276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:58.561823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:58.574394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:58.575883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:58.577081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-88430238-a579-4ff0-9c2e-812eb8b467e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110276 Oct 19 13:31:58.577631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 822/1713] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:31:58.636439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:58.645793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-18feaad0-636a-435a-89be-fe7eb5cef3ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188583 Oct 19 13:31:58.646368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 892/1714] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:58 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:31:59.618178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:59.618785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:59.625903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:59.626803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:59.627156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:59.627854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:59.628761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:59.629349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:59.669509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:31:59.670245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:31:59.678144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:59.678654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:59.679082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:59.679787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:31:59.680301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:31:59.680700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:31:59.695838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:59.705263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:59.706834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:59.708177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f9a72a3a-76b7-48cf-a66d-27af08fa3973 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094095 Oct 19 13:31:59.709189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 823/1715] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:31:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:31:59.828797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:31:59.837962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-27fc08b2-40e0-4c95-8be2-8fb0a3cc6631 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172301 Oct 19 13:31:59.838568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 893/1716] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:31:59 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:00.733895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:00.735003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:00.741660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:00.742169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:00.742594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:00.743295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:00.743737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:00.744152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:00.760553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:00.818336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:00.827392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:00.829063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:00.830393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-234a8ef9-0737-4c26-8141-d0f3b16ca95a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100695 Oct 19 13:32:00.830967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 824/1717] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:00.862636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:00.863273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:00.874307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:00.874820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:00.875345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:00.876418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:00.876903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:00.877309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:01.036989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:01.045868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-956be253-97d5-4b1b-8dbb-832c71246e1b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.187342 Oct 19 13:32:01.046507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 894/1718] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:01.860356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:01.861057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:01.867725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:01.868228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:01.868649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:01.869375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:01.869815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:01.870230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:01.958187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:01.967475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:01.968943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:01.970227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7ceb27ed-1f6b-4920-8bb2-79a1bc8db0ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.114144 Oct 19 13:32:01.970789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 825/1719] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:02.070518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:02.071134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:02.078112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:02.078606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:02.079050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:02.079761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:02.080219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:02.080645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:02.232039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:02.240855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fd9918a6-fe89-4eb8-b505-a874f4d187a4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174238 Oct 19 13:32:02.241467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 895/1720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:02.999781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:03.001348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:03.012354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:03.013001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:03.013760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:03.014911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:03.015361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:03.015993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:03.099046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:03.108492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:03.110049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:03.111225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad515ffe-a365-4991-99b9-c6dcb9b07829 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.118849 Oct 19 13:32:03.111791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 826/1721] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:03.265135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:03.265965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:03.273963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:03.274462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:03.274908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:03.275635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:03.276091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:03.276512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:03.420678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:03.430615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b43d9ac0-8f21-41e4-b52c-2bbc53c65be3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169593 Oct 19 13:32:03.431215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 896/1722] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:03 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:04.138135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:04.138769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:04.146163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:04.146665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:04.147115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:04.147838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:04.148290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:04.148710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:04.213301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:04.222985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:04.224452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:04.225696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6dfde412-b893-43e5-bac9-bcf41b8c74e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091568 Oct 19 13:32:04.226232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 827/1723] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:04.455256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:04.455829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:04.462696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:04.463184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:04.463636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:04.464340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:04.464794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:04.465245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:04.607968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:04.626715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9fbaf9bf-fa82-475f-9e9b-3d316f6103d8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175489 Oct 19 13:32:04.627474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 897/1724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:05.254412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:05.255390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:05.262891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:05.263365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:05.263795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:05.264505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:05.264970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:05.265729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:05.334997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:05.344518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:05.346011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:05.347184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bf2c4a07-e622-444e-831c-bcc7224117c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098145 Oct 19 13:32:05.347738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 828/1725] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:05.651269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:05.651932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:05.659358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:05.659820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:05.660272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:05.661007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:05.661455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:05.661860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:05.802410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:05.811559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e87896c6-1226-41f9-8f69-526ff0bc6e66 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164154 Oct 19 13:32:05.812151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 898/1726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:06.383033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:06.383759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:06.391197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:06.391683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:06.392109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:06.392945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:06.393419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:06.393859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:06.459911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:06.470260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:06.471920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:06.473059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b95a0050-8652-4a56-9b88-31873218304e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094063 Oct 19 13:32:06.473599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 829/1727] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:06.835890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:06.836533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:06.843541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:06.844431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:06.845107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:06.845640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:06.846073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:06.846491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:06.979691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:06.988983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fa2c2ba1-bbb7-4f94-b405-edb272aa241f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157559 Oct 19 13:32:06.989560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 899/1728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:06 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:07.498868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:07.499533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:07.507917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:07.508394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:07.508791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:07.509545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:07.509981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:07.510388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:07.581145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:07.590204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:07.591631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:07.592784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-32d96ad0-8374-4f09-aa27-83139be3ce51 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097968 Oct 19 13:32:07.593371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 830/1729] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:08.013873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:08.014803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:08.024331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:08.024824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:08.025290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:08.026016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:08.026464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:08.026878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:08.174308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:08.183499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-92f3bfaf-c4f2-4e9b-b6d8-218aa8f1e1e8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173624 Oct 19 13:32:08.184221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 900/1730] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:08.619109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:08.619911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:08.627425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:08.627914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:08.628348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:08.629099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:08.629551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:08.629974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:08.713004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:08.722300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:08.723883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:08.725053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1fe42618-35cd-4335-8bca-b9bf34208ae6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110169 Oct 19 13:32:08.725660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 831/1731] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:09.209521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:09.210217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:09.217261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:09.217860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:09.218692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:09.219453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:09.220198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:09.220894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:09.365107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:09.373849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7832dabf-f2ff-4e13-8aa1-4ee250ba2921 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169793 Oct 19 13:32:09.374579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 901/1732] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:09 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:09.753397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:09.754118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:09.760784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:09.761300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:09.761731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:09.762422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:09.762864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:09.763279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:09.831611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:09.842403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:09.844041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:09.845244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-23f05806-ac64-4918-8fd1-f54db463144d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096741 Oct 19 13:32:09.845805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 832/1733] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:10.400587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:10.401364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:10.409424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:10.409918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:10.410347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:10.411079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:10.411505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:10.411920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:10.568722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:10.577470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b4531aa7-2662-4601-86e2-130779f760ff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180775 Oct 19 13:32:10.578237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 902/1734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:10.870598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:10.871202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:10.878973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:10.879464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:10.879895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:10.880613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:10.881098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:10.881517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:10.950707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:10.961209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:10.962662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:10.963842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0350d7d1-d972-4eb4-97ee-da2a838ce7da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097375 Oct 19 13:32:10.964414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 833/1735] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:11.603254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:11.603829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:11.611356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:11.611846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:11.612286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:11.613049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:11.613507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:11.613921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:11.767792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:11.776614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-869828e9-041e-439e-9006-c229b8bfb823 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.178043 Oct 19 13:32:11.777290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 903/1736] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:11.990262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:11.990884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:11.998139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:11.998590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:11.999019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:11.999841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:12.000497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:12.001361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:12.074691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:12.084634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:12.086103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:12.087277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f0da00a5-5951-4f65-a946-43ca7eff92a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101399 Oct 19 13:32:12.087840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 834/1737] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:12.803078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:12.803763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:12.806110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=50 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:12.811241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:12.811910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:12.813552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:12.813952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:12.814506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:12.815024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:12.950056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:12.960017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b10b8473-30f2-4611-bbb4-3cc7300fec30 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161041 Oct 19 13:32:12.960612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 904/1738] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:13.114581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:13.115321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:13.123130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:13.123727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:13.124420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:13.125674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:13.126900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:13.127602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:13.198084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:13.207693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:13.209161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:13.210308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-074c6d44-0a00-4639-9f11-5e14f0a0b595 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100333 Oct 19 13:32:13.210864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 835/1739] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:13.984707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:13.985488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:13.992364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:13.992879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:13.993334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:13.994117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:13.994579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:13.994992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:14.136433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:14.140330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:14.150537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0d64d297-a107-413e-b96c-e2c29ea0c6c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170052 Oct 19 13:32:14.151162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 905/1740] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:13 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:14.251506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:14.252084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:14.258902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:14.259380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:14.259781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:14.260493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:14.260991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:14.261412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:14.328693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:14.337641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:14.339078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:14.340212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4e718c70-881f-41be-8cab-08b818a35417 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093210 Oct 19 13:32:14.340764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 836/1741] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:15.175203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:15.176140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:15.182949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:15.183424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:15.183857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:15.184558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:15.185032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:15.185452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:15.330924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:15.339555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ff276d11-51d0-478e-8d4e-e68cc6c593e4 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168629 Oct 19 13:32:15.340013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 906/1742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:15 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:15.367140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:15.367734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:15.370217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=54 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:15.379396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:15.380499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:15.381301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:15.382702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:15.383650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:15.384201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:15.451360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:15.460574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:15.462024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:15.463158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3d8fd0d8-601e-4d27-8e27-1b4bb7d69a7e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100005 Oct 19 13:32:15.463712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 837/1743] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:16.173852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:16.174516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:16.180646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.181283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.181818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.182333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.182684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.183103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.216896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:32:16.309573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-45a6e83c-59dc-49a9-93d4-d7fc123c7cf1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 204 len: 0 microversion: 2.1 time: 0.139773 Oct 19 13:32:16.310317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 907/1744] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:32:16 2022] DELETE /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:32:16.319831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:16.320454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:16.326861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.327340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.327829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.328530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.329006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.329415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.364619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:16.365346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:16.373133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.373629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.374060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.374896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.375355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.376108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.491096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:16.501180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62edac07-6bdb-499a-b3a8-65be2a06a0e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.185016 Oct 19 13:32:16.501877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 838/1745] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:16.506940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:16.507666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:16.519334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.520206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.520783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.521841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:16.522803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:16.523147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:16.541185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:16.554371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8fa1e27d-db26-4ba0-885c-88f344131822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.193972 Oct 19 13:32:16.555075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 908/1746] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:16.594279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:16.608369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:16.611618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:16.613529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2c858de7-8af0-4abf-9e99-faf95fa8add0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110296 Oct 19 13:32:16.614465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 839/1747] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:17.532783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:17.533451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:17.542618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.543158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.543522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.544234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.544686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.545157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.579594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:17.580423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:17.587151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.587603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.588024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.588752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.589220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.589627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.698958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:17.709566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b1ef25a0-7c2c-48e7-8582-d3e1d17445ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.180842 Oct 19 13:32:17.710158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 909/1748] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:17.716454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:17.716454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:17.723691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.724175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.724622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.725352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:17.726595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:17.726595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:17.737145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:17.746543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e4e0723-1684-43bd-ac6b-99c59e8a42ac tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171487 Oct 19 13:32:17.747120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 840/1749] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:17.806876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:17.816274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:17.817750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:17.818909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd85930b-eb6f-4d9f-8749-8213a11c6a86 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.107830 Oct 19 13:32:17.819513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 910/1750] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:18.743759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:18.744363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:18.751397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.751871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.752290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.753018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.753458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.753883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.756506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:18.772020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:18.772629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:18.779236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.779720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.780159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.781002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.781467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.781895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.890029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:18.900043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-56207bc7-fdc2-4edc-947e-9a92f94052fc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160272 Oct 19 13:32:18.900669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 841/1751] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:18.908151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:18.909272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:18.919547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.920373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.921115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.922160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:18.922800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:18.923406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:18.943421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:18.952468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-89fd54d1-6a2d-4519-831c-67c55f610074 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.184286 Oct 19 13:32:18.953267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 911/1752] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:18.990197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:18.999675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:19.001988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:19.003155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8a1f4c70-c6c3-49dd-b02e-f9f63da5a214 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101564 Oct 19 13:32:19.003742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 842/1753] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:19.926153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:19.926774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:19.933178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:19.933713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:19.934221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:19.935026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:19.935545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:19.936035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:19.977491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:19.978236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:19.987770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:19.988609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:19.989424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:19.990656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:19.991468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:19.992221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:20.075760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:20.088693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e5297b06-bdf5-45e4-accc-eec1640b4e42 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166240 Oct 19 13:32:20.089774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 912/1754] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:20.095975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:20.096581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:20.103023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:20.103506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:20.103938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:20.104637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:20.105117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:20.105538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:20.152138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:20.161687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a28ffbe2-d786-452f-82b5-aa998d6c6862 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188434 Oct 19 13:32:20.162248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 843/1755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:19 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:20.168815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:20.178581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:20.179987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:20.181159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3cedcd72-b6f6-4e0f-9336-551e267b64a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089971 Oct 19 13:32:20.181717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 913/1756] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:21.114660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:21.115340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:21.121993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.122480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.122899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.123607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.124043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.124514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.185402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:21.186025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:21.193008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.193486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.193913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.194595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.195037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.195454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.278388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:21.294621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-240ce089-a755-4e75-ba26-e00fab16c02b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.184202 Oct 19 13:32:21.295559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 844/1757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:21.303849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:21.304827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:21.316561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.316561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.318368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.319539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:21.320295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:21.320960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:21.341398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:21.350993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b62060d3-35ce-4311-956e-765d9917c14f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169499 Oct 19 13:32:21.351575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 914/1758] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:21.403262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:21.413204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:21.414640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:21.415899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b8430881-4b1d-43c7-b030-ab7150f2c9bb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.119025 Oct 19 13:32:21.416335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 845/1759] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:22.320693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:22.321539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:22.331130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.331617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.332050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.332782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.333280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.334274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.374857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:22.375989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:22.383962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.384434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.384866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.385589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.386031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.386444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.463441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:22.472451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f707deda-41c8-4aa6-8427-e768e1dc7763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155904 Oct 19 13:32:22.473039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 915/1760] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:22.477677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:22.478302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:22.485508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.486294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.486947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.487983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:22.488714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:22.489542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:22.542421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:22.552637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-537ce898-d337-488d-830e-6f54614967fc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.181679 Oct 19 13:32:22.553259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 846/1761] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:22 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:22.564267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:22.573766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:22.575068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:22.576235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fff0c567-442a-4d98-80cd-f39aa89cfd8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102293 Oct 19 13:32:22.576795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 916/1762] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:23.496101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:23.505441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:23.507279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.507787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.508196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.508903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.509354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.509769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.575875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:23.576462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:23.584102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.584593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.585067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.585775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.586219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.586638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.652147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:23.661870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f257b0de-192a-4ac2-8a64-9a4a0ac0e26d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169769 Oct 19 13:32:23.662476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 847/1763] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:23.667493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:23.668120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:23.675992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.676495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.676952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.677728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:23.678199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:23.678579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:23.748679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:23.750043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:23.758768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b53d00c0-3ccf-4c92-8e89-354bee83a5a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.186888 Oct 19 13:32:23.761472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 917/1764] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:23.768126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:23.771126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:23.772581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-debcfd11-3c0e-480a-a390-c46017e4b6b6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.109101 Oct 19 13:32:23.773354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 848/1765] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:24.687458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:24.688255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:24.694986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.695455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.695889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.696581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.697085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.697506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.784264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:24.785197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:24.795324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.796043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.796666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.797977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.798565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.799189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.844645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:24.854283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ceb37214-d8a5-4048-9fbf-e7bbf3aa4512 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.171201 Oct 19 13:32:24.854949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 918/1766] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:24.859900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:24.860812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:24.867322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.868005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.868617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.869345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:24.869790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:24.870208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:24.939064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:24.948145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:24.949651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:24.950843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4711e842-c31a-4557-a4b0-92e2f6bc3a8e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094900 Oct 19 13:32:24.951617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 919/1767] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:24.972455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:24.981076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8651e97e-7bc9-47a3-97a2-b5c7a4806a44 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.202473 Oct 19 13:32:24.981652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 849/1768] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:25.882934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:25.883589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:25.890408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:25.890938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:25.891419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:25.892115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:25.892587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:25.893053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:25.979125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:25.979896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:25.987699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:25.988162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:25.988595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:25.989356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:25.989827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:25.990259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:26.052348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:26.054769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:26.063397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28bf83de-96e9-450e-9fc0-4a7f8a481fd7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.184383 Oct 19 13:32:26.064478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 920/1769] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:26.068993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:26.069603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:26.072275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:26.085637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:26.085949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:26.086131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:26.086550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:26.087275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:26.087737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:26.088120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:26.088266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:26.090315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-14ed4b33-b1f3-4f65-9c6f-2f7b2bd22fc6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.117380 Oct 19 13:32:26.091787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 850/1770] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:26.230424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:26.240441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-71f419d3-245d-4440-9186-bea83ca73314 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174938 Oct 19 13:32:26.241150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 921/1771] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:27.088510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:27.089215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:27.096817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.097334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.097756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.098450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.098890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.099301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.130131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:27.131015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:27.137657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.138141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.138580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.139270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.139730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.140151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.212140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:27.222116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:27.223638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:27.224748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3de13bd6-8fe6-4d46-9f10-42d808472222 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098592 Oct 19 13:32:27.225558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 922/1772] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:27.265236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:27.266087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:27.272394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:27.273022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.273473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.274051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.274645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:27.275314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:27.275879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:27.281127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c0f133dd-f275-417f-ae43-ef358dae4172 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.196505 Oct 19 13:32:27.281749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 851/1773] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:27.425421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:27.435220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0fd7a47e-0065-48dd-a115-01c177f2ca84 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174268 Oct 19 13:32:27.435841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 923/1774] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:28.250948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:28.251600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:28.258757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.259238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.259703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.261211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.261662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.262077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.316164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:28.317500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:28.325340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.325871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.326317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.327507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.328522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.329261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.330053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:28.339208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:28.340663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:28.341853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7ef00b79-2277-4b2f-b561-518d9ee54031 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095644 Oct 19 13:32:28.342428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 852/1775] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:28.459481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:28.460091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:28.464682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:28.466776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.467266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.467696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.468399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:28.469062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:28.469511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:28.473872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fcff0c51-dfd5-4ff9-aa85-c8578c2fa59e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161728 Oct 19 13:32:28.474437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 924/1776] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:28.610069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:28.619201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-80f5e74c-d9e0-491f-8bb9-e787c5526fa3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163636 Oct 19 13:32:28.619802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 853/1777] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:28 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:29.381048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:29.381664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:29.388289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.388769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.389235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.389933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.390359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.390811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.464797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:29.475475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:29.476937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:29.478105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c4a4be96-345b-4f52-bbaf-6cc997d7ec40 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103492 Oct 19 13:32:29.478674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 925/1778] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:29.498163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:29.498781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:29.505775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.506252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.506686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.507382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.507830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.508254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.644729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:29.645380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:29.651813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.652306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.652764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.653503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:29.653927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:29.654371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:29.668540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:29.679666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-38fb3429-913e-4731-8a9a-f6e55085c64b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.185464 Oct 19 13:32:29.680264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 854/1779] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:30.064948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:30.074513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-178b0724-5816-4680-83e9-d1c5e798fb95 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.433800 Oct 19 13:32:30.075101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 926/1780] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:30.506148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:30.506986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:30.514434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:30.514909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:30.515331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:30.516019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:30.516453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:30.516966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:30.588285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:30.598897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:30.600587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:30.601932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b64596f8-7a31-46a2-8dce-95cc350f1655 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102192 Oct 19 13:32:30.602490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 855/1781] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:30.706504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:30.707527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:30.719267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:30.720159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:30.720886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:30.721620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:30.722066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:30.722505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:30.871489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:30.882610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f1c9a86-8922-420a-baff-ffbf4fcc845a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.182299 Oct 19 13:32:30.883207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 927/1782] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:31.104831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:31.105487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:31.114181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.114664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.115104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:31.115829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.116301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.116735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:31.265590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:31.274616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7c4d97cd-d6e6-4fb3-86cd-afad58769822 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175451 Oct 19 13:32:31.275187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 856/1783] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:31.629032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:31.629638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:31.636453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.636941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.637462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:31.638564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.639251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.639868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:31.712077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:31.722498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:31.723952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:31.725181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ce64592f-07f5-4e6a-854e-65b7f6e29732 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100942 Oct 19 13:32:31.725748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 928/1784] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:31.911273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:31.911981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:31.918661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.919140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.919568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:31.920258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:31.920697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:31.921139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:32.068929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:32.071261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:32.078273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9f101f57-3a6b-4d99-88ff-5b1b3d88b84b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.171463 Oct 19 13:32:32.078847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 857/1785] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:32.305085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:32.305700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:32.312478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:32.313011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:32.313474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:32.314836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:32.315030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:32.315308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:32.454560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:32.463266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5a526e5d-d12d-4f10-8925-b10c31f99ce7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162606 Oct 19 13:32:32.463854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 929/1786] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:32.751060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:32.753437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:32.758200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:32.758895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:32.759099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:32.759781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:32.760215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:32.760622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:32.826737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:32.839671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:32.841895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:32.843329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7ac35936-3e20-4a4b-be74-924ddc59484d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096929 Oct 19 13:32:32.843880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 858/1787] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:33.103183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:33.103818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:33.110701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.111184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.111623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.112333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.112790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.113250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.253504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:33.262391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1de8aa71-4033-4f90-b965-e7c498449b56 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163359 Oct 19 13:32:33.262979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 930/1788] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:33.487663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:33.488265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:33.495184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.495680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.496101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.496805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.497287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.497707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.646270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:33.656878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bf66e2c5-3a32-4e38-a022-4660b7e320db tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173093 Oct 19 13:32:33.657673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 859/1789] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:33 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:33.872445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:33.873603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:33.881335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.881851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.882288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.883041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:33.883498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:33.883937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:33.956379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:33.967681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:33.969236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:33.970516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed5d70fa-2f45-46db-a09f-9d5659b7ba59 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104856 Oct 19 13:32:33.971715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 931/1790] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:34.286574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:34.287194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:34.294199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:34.294770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:34.295290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:34.296028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:34.296507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:34.297121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:34.447275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:34.456654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-47214ed8-2373-4aa8-b86f-c7651a054290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174298 Oct 19 13:32:34.457273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 860/1791] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:34.682645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:34.683421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:34.691215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:34.691697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:34.692123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:34.692818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:34.693301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:34.693718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:34.839280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:34.848564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-35b0a9bb-c450-48bf-acef-02754ae1cc4f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170771 Oct 19 13:32:34.849197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 932/1792] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:34 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:34.998115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:34.998693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:35.006343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.006818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.007248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:35.007955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.008405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.008813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:35.078808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:35.090634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:35.092096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:35.093514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5d5f71ea-b106-4b85-9e2f-812ebeb7b816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099683 Oct 19 13:32:35.094077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 861/1793] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:35.485801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:35.486600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:35.493521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.494007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.494439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:35.495140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.495586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.496008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:35.648885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:35.659594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b330b5ad-0b6a-448f-8d7d-e8aaddb00e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.179692 Oct 19 13:32:35.660179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 933/1794] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:35.873379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:35.873984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:35.882651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.883214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.883572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:35.884296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:35.884740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:35.885211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:36.038619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:36.048204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d6a0c80-f1b4-429d-83f5-a466f94e9fd8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.179470 Oct 19 13:32:36.048954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 862/1795] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:36.120889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:36.121511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:36.129387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:36.129806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:36.130236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:36.130944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:36.131391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:36.131811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:36.199652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:36.209748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:36.211172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:36.212461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c5b62203-a39f-4868-9723-3dd2dd77a432 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095721 Oct 19 13:32:36.213146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 934/1796] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:36.688152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:36.688761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:36.695234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:36.695703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:36.696127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:36.696819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:36.697284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:36.697690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:36.836549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:36.845599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-df26bfb4-d31c-4f84-9806-c7cf9f30631d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161436 Oct 19 13:32:36.846322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 863/1797] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:37.074285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:37.074808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:37.081716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.082229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.082677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:37.083398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.083838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.084248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:37.219052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:37.227665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-00d4dd3c-e774-4629-ae1f-8fe007ac845e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158430 Oct 19 13:32:37.228237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 935/1798] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:37.240126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:37.240743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:37.247174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.247643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.248065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:37.248758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.249212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.249616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:37.317500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:37.326972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:37.328373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:37.329555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-60893e5d-b910-4a3a-b745-f71c7009c563 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094097 Oct 19 13:32:37.330112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 864/1799] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:37.869896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:37.870171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:37.877977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.878461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.878937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:37.879639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:37.880117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:37.880525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:38.034661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:38.043835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0acca77f-a976-49a6-9e8f-b2cf887e4e6a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.178203 Oct 19 13:32:38.044385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 936/1800] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:38.252052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:38.252631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:38.259980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:38.260459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:38.260889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:38.261599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:38.262056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:38.262476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:38.362932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:38.364157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:38.376228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:38.377233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:38.378039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:38.379443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:38.380363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:38.381241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:38.410802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:38.429054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:38.438151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0313f9c5-ac25-4caa-b918-df4bb41e9662 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.190378 Oct 19 13:32:38.438752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 865/1801] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:38 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:38.462965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:38.475981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:38.478167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:38.479934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-53a5c8da-0dfd-4d38-b757-15f6de9ae473 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.124254 Oct 19 13:32:38.480889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 937/1802] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:39.073792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:39.074397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:39.080681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.081197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.081753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.082765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.083361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.083793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.225097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:39.233628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bac9ce7b-7195-49c3-968d-37a07c6871a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163965 Oct 19 13:32:39.234212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 866/1803] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:39.467147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:39.467765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:39.475596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.476066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.476508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.477253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.477705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.478127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.516976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:39.518435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:39.525520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.526002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.526492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.527221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:39.527663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:39.528072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:39.592266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:39.603631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:39.605112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:39.606296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6f88e239-f145-4c5b-9436-c75afba0d064 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096169 Oct 19 13:32:39.606858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 867/1804] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:39.646720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:39.655203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3886b90e-b183-407c-918f-7362393bb828 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.192954 Oct 19 13:32:39.655786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 938/1805] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:39 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:40.258405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:40.259009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:40.266203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.267042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.267464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.268311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.268780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.269753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.431599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:40.443845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d136470b-345d-40ca-ad02-8a5f37bd4ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.189554 Oct 19 13:32:40.444434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 868/1806] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:40.633906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:40.634931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:40.645823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.646408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.647016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.647895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.648397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.648820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.680688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:40.681374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:40.688516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.689116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.689555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.690291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:40.690782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:40.691201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:40.727836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:40.737093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:40.738457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:40.739922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d002a9f-a09b-4fcf-8b6a-32a36663572d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.111221 Oct 19 13:32:40.740704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 939/1807] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:40.838230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:40.849762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-77f89824-fe56-445b-bf21-05bd6c134e1e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173793 Oct 19 13:32:40.850402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 869/1808] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:40 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:41.468678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:41.469316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:41.478612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.479020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.479467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:41.480171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.480613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.481107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:41.622742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:41.633072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb04a3b6-72bb-4a45-8ee8-5a0915335ac3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.168986 Oct 19 13:32:41.633648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 940/1809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:41.765763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:41.766466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:41.773748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.774235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.774659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:41.775360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.775805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.776213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:41.843815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:41.857618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:41.859636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:41.861051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d89a1175-6b4a-4556-bfc0-7f8a36d5656d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099188 Oct 19 13:32:41.861838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 870/1810] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:41.873437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:41.874040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:41.881650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.882142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.882622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:41.883330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:41.883782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:41.884209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:42.040621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:42.049599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aaca8933-953b-41a6-bc4f-0544b4782451 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.180063 Oct 19 13:32:42.050186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 941/1811] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:41 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:42.662038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:42.662791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:42.669793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:42.670276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:42.670715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:42.671419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:42.672039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:42.672828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:42.830209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:42.839251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6c4ad65e-f517-46a7-a227-1aa3d3ef2d00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.182929 Oct 19 13:32:42.839894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 871/1812] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:42.897265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:42.897921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:42.900519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:42.906101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:42.906604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:42.907025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:42.907756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:42.908207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:42.908627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:42.981475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:42.992340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:42.993995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:42.995170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8e25a6fe-f0b8-4ceb-a387-14da7d586d64 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102265 Oct 19 13:32:42.996003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 942/1813] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:43.072709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:43.073352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:43.080001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:43.080512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:43.080968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:43.081669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:43.082082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:43.082496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:43.243181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:43.255686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb340547-b6b0-4e04-b1c7-a7e72d3e12c1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.186747 Oct 19 13:32:43.256509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 872/1814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:43 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:43.864041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:43.864933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:43.873054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:43.873542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:43.873975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:43.874666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:43.875463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:43.875886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.018512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:44.022424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:44.023124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:44.028057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-400a83dd-f3c0-4e5b-8404-17740c64e666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.168738 Oct 19 13:32:44.028622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 943/1815] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:44.029928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.030478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.030952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.031696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.032138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.032585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.101195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:44.110258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:44.111703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:44.112852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1bc78d5-a7ec-4fc2-a327-466d696328f6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094606 Oct 19 13:32:44.113441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 873/1816] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:44.280780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:44.281490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:44.287933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.288452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.288986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.289690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:44.290139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:44.290552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:44.432973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:44.443883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-272ae607-4160-4014-b77f-d70e6d482c96 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167170 Oct 19 13:32:44.444675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 944/1817] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:45.054626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:45.055671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:45.063567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.064080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.064512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.065345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.065844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.066356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.082752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:45.138670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:45.139320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:45.149432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.150332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.151137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.152446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.153499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.154248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.225224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:45.229127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:45.236265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1977e0b-c7b0-4495-b8a1-13a7cb716742 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.187376 Oct 19 13:32:45.237123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 874/1818] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:45.244894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:45.246404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:45.247490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-da14fb3d-37ff-4668-aacd-32659d76fb0c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.112878 Oct 19 13:32:45.248235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 945/1819] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:45.476654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:45.477291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:45.479228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=76 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:45.484842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.485342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.485805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.486502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:45.486949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:45.487366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:45.633829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:45.642772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-80ad34f5-c5a0-4154-9d9a-8a7845c8b7c5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170462 Oct 19 13:32:45.643322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 875/1820] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:45 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:46.261431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:46.262078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:46.274004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.274501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.275136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.276031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.276463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:46.277184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.277184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.277380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:46.284541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.285283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.285727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.286461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.286921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.287460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.357675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:46.366722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:46.368398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:46.369754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-87a086fa-d2ab-4cf3-92f0-7207fa4c6144 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098536 Oct 19 13:32:46.370329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 876/1821] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:46.431586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:46.440621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f43d82e-2383-4266-bed4-be323b8b7e0a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.183049 Oct 19 13:32:46.441261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 946/1822] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:46.667770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:46.668381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:46.674858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.675344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.675774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.676480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:46.676949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:46.677365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:46.829068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:46.840735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-252885aa-b087-4c4f-820a-7fc42c543fb2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176906 Oct 19 13:32:46.841445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 877/1823] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:46 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:47.396493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:47.397136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:47.404446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.404964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.405453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:47.406191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.406653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.407079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:47.464037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:47.464751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:47.472480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.473401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.473804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:47.475015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.476278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:47.477360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.477360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:47.484932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:47.486383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:47.487561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0652785e-c5ec-41a8-9eed-63a28a367426 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095688 Oct 19 13:32:47.488137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 947/1824] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:47.629289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:47.638458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9a6bd628-a4fb-4f67-b431-60aa8ae2d190 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.178471 Oct 19 13:32:47.639046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 878/1825] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:32:47.868220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:47.868946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:47.870973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:32:47.871118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 (ip 10.222.0.17) !!! Oct 19 13:32:47.877522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.877999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.878432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:47.879131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:47.879607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:47.880028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:48.018851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:48.028999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-30f3a1e3-987b-4111-80b6-91400015b4cd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164808 Oct 19 13:32:48.029580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 948/1826] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:47 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:48.518541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:48.519469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:48.530880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:48.531667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:48.532380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:48.533609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:48.534342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:48.535016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:48.611195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:48.620647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:48.622141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:48.623398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b5babf6-327a-436e-99d4-c198af76e613 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.112008 Oct 19 13:32:48.623901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 879/1827] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:48.665816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:48.666434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:48.673440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:48.673932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:48.674361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:48.675069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:48.675548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:48.675971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:48.814398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:48.823656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5b05cdd-23b8-4fe6-961b-1365a2d41549 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164051 Oct 19 13:32:48.824225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 949/1828] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:49.054159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:49.054767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:49.056885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:32:49.057044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:32:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 (ip 10.222.0.17) !!! Oct 19 13:32:49.066294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.066918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.067523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:49.068339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.068778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.069220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:49.206141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:49.215999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e3b2710b-e3f6-4cb1-a410-8a4abc9787b8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165520 Oct 19 13:32:49.216617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 880/1829] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:49 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:49.651335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:49.651777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:49.658363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.658845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.659338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:49.659989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.660428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.660880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:49.729323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:49.739051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:49.740472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:49.741667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75eb9510-c2b7-4ee0-9158-a373e9869f84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095092 Oct 19 13:32:49.742244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 950/1830] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:49.847958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:49.848577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:49.855675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.856150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.856549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:49.857281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:49.857718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:49.858154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:50.004603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:50.013586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7a32bc50-1d20-499e-91d9-185c229040e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169603 Oct 19 13:32:50.014781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 881/1831] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:50.241279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:50.241809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:50.249031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:50.249478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:50.250263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:50.250984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:50.251429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:50.251844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:50.391936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:50.402570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-020a6065-92ba-4b38-bc62-9f74b497352a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165266 Oct 19 13:32:50.403466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 951/1832] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:50 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:50.770046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:50.770652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:50.782342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:50.782844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:50.783241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:50.783926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:50.784386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:50.784774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:50.854583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:50.869833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:50.871127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:50.872958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4532775-2f19-48d8-be26-b13ab46bdd09 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.108264 Oct 19 13:32:50.873854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 882/1833] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:51.039360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:51.040094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:51.049819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.050456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.051077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.051999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.052580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.053266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.192831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:51.206314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1ebb2745-a4bc-422b-99bc-337b5d9772c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.172526 Oct 19 13:32:51.207227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 952/1834] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:51.435848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:51.436454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:51.442949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.443443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.443878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.444526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.445037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.445453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.597265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:51.607725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b7e9f06c-7f4f-436d-93e0-e142d4ad3e90 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175880 Oct 19 13:32:51.608288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 883/1835] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:51.903233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:51.903745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:51.910459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.910954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.911388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.912086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:51.912544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:51.913002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:51.982712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:51.991978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:51.993451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:51.994615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-85807cd9-e715-4950-9b6a-4a7bf017000b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097857 Oct 19 13:32:51.995225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 953/1836] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:52.233380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:52.234009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:52.241843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:52.242373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:52.242892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:52.243657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:52.244155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:52.244614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:52.392282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:52.401805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9b3391bc-5dec-4e98-87d0-a84ac66c45dd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173587 Oct 19 13:32:52.402375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 884/1837] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:52.635565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:52.636469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:52.647063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:52.647825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:52.648520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:52.649714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:52.650389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:52.651054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:52.653854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:52.786506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:52.797411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-007cb0a4-98e9-4733-b6ef-ed70e1f06f81 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167887 Oct 19 13:32:52.797996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 954/1838] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:52 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:53.021674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:53.022416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:53.030405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.030995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.031518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.032366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.033057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.033492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.105089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:53.114669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:53.116094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:53.117299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b61bd94e-a2e8-4948-9e6b-5d48530b22a7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100559 Oct 19 13:32:53.117832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 885/1839] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:53.433706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:53.434326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:53.441043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.441525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.441954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.442644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.443093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.443506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.590023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:53.602916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c0fd942-664f-4612-b893-fe90d5ed0907 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.175126 Oct 19 13:32:53.603652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 955/1840] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:53.821533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:53.822096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:53.829479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.829959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.830396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.831087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:53.831530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:53.831948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:53.975546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:53.984461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-05aea3b9-8b9b-4ad9-9833-9c7978140811 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166923 Oct 19 13:32:53.985063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 886/1841] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:53 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:54.152073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:54.152657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:54.155167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:32:54.155320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 (ip 10.222.0.17) !!! Oct 19 13:32:54.166962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:54.167723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:54.168468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:54.169532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:54.170150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:54.170736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:54.237419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:54.247304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:54.248817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:54.250356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78fc4304-514e-4db9-b30a-481b312b5fa2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104608 Oct 19 13:32:54.250919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 956/1842] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:54.635222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:54.636415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:54.642588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:54.643070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:54.643519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:54.644199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:54.644660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:54.645089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:54.785340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:54.794463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-29b78f8c-f186-44d1-8718-fbe502992f2d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164582 Oct 19 13:32:54.795067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 887/1843] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:55.014750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:55.015605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:55.024353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.025101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.025696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.026724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.027179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.027594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.180216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:55.193280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-02d73bad-ec39-44c0-8401-96efc0310baf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183807 Oct 19 13:32:55.194109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 957/1844] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:55 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:55.275982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:55.276658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:55.284190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.284659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.285115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.285808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.286246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.286652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.354436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:55.363624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:55.365135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:55.366259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-19824edb-e377-4239-9bda-b38264a5d314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094374 Oct 19 13:32:55.366808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 888/1845] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:55.821844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:55.822667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:55.832735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.833577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.834271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.835366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:55.836127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:55.836797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:55.987379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:56.000336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eae1266d-24f8-437f-891f-9bacd88de9cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.184332 Oct 19 13:32:56.001238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 958/1846] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:56.222315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:56.223107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:56.231775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:56.232224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:56.232667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:56.233398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:56.233822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:56.234231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:56.373066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:56.386323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f6d21d68-d104-4de8-a63e-401ca5365a0e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169701 Oct 19 13:32:56.387009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 889/1847] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:56.394444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:56.395141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:56.401898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:56.402380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:56.402813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:56.403547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:56.404013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:56.404410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:56.468318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:56.477478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:56.478829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:56.480020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-37c17c30-8a24-436f-b746-92591e9b8325 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089876 Oct 19 13:32:56.480838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 959/1848] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:57.029391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:57.030107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:57.036681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.037192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.037623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.038315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.038761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.039179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.177346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:57.187829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab8d6192-89e2-43f7-b5b3-1028d79febc5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163348 Oct 19 13:32:57.188393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 890/1849] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:57.411322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:57.411991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:57.419172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.419653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.420067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.420773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.421257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.421706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.510543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:57.511178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:57.517947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.518404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.518822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.520238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:57.520694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:57.521693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:57.524440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:32:57.557102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:57.565989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-54029f95-87c3-4075-b6a4-41a7c136a363 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159150 Oct 19 13:32:57.566507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 960/1850] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:57.589241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:57.598688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:57.601239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:57.601239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d59e01c-a4cf-4117-a63a-880d43cce4e5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094612 Oct 19 13:32:57.601807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 891/1851] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:58.220455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:58.220998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:58.229927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.230539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.230983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.231687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.232142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.232536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.371960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:58.381363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9595eeed-3ce6-46f5-b2da-b3c529fcbfde tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164952 Oct 19 13:32:58.382070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 961/1852] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:58.589869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:58.590515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:58.597668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.598149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.598577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.599276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.599722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.600155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.626903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:58.627502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:58.635846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.636453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.636818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.637513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:58.637983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:58.638383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:58.706656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:58.715703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:58.717197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:58.718351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c8c7e093-9435-4f8d-9152-1066d8d9eb13 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095859 Oct 19 13:32:58.718912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 962/1853] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:32:58.738973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:58.747382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-19f03ef1-d32d-42ab-9c5b-73e851033126 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161780 Oct 19 13:32:58.747946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 892/1854] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:58 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:59.406630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:59.407531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:59.414920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.415694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.416416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.417703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.418158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.418641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.561883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:59.570774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01f9cd7d-4d5e-4e88-b15d-ca9f11a39f60 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.168463 Oct 19 13:32:59.571290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 963/1855] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:32:59.743104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:59.743689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:59.753856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.754649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.755368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.756514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.757259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.757998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.771636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:32:59.772247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:32:59.779625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.780111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.780547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.781281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:32:59.781731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:32:59.782151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:32:59.825893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:59.834981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:59.836382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:59.837556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c8456bb-3ec0-4fe2-abfc-166566062b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098567 Oct 19 13:32:59.838109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 893/1856] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:32:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:32:59.917942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:32:59.926619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-02f7d288-4ff2-4a79-932c-397677cdb17f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158894 Oct 19 13:32:59.927191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 964/1857] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:32:59 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:00.596008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:00.596661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:00.604791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.605638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.606067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:00.606758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.607208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.607621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:00.742764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:00.752292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0a7f8b8a-8868-4b13-a49a-6fafc814286a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161369 Oct 19 13:33:00.752979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 894/1858] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:00.862616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:00.863201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:00.870417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.871018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.871462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:00.872175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.872634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.873096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:00.938297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:00.947373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:00.949041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:00.950020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-57b061d1-8438-4784-92cb-24bf77c5d587 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091595 Oct 19 13:33:00.950183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:00.950580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 965/1859] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:00.950735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:00.957320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.957799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.958225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:00.959067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:00.959516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:00.959916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:01.093415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:01.104520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad12101e-bc8e-4e98-bde1-bf491fca59ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158045 Oct 19 13:33:01.105077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 895/1860] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:01.776667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:01.777586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:01.784205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:01.784690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:01.785157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:01.785860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:01.786314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:01.786737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:01.932758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:01.946020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-025e31be-90b9-4c39-b71d-2865ff122457 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173095 Oct 19 13:33:01.946864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 966/1861] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:01.975511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:01.976043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:01.984202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:01.984202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:01.984202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:01.985262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:01.985262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:01.986522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:02.061237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:02.069857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:02.071304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:02.072435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0bf716f1-7071-4da1-af58-02d243155c0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100975 Oct 19 13:33:02.073022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 896/1862] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:02.135308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:02.136627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:02.143334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:02.143823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:02.144261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:02.145013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:02.145464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:02.145888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:02.278809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:02.287800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1a893540-9973-4c75-a94c-c56f3ea25b52 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159105 Oct 19 13:33:02.288398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 967/1863] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:02.974974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:02.975870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:02.984409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:02.984905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:02.985340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:02.986031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:02.986474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:02.986887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:03.098180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:03.098744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:03.105723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:03.106210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:03.106643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:03.107331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:03.107806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:03.108230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:03.128505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:03.137456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-53d00dcb-a918-4444-ac26-099231d8d39b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169269 Oct 19 13:33:03.138058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 897/1864] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:03.172474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:03.181444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:03.182872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:03.184296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e7c89361-13c4-46c8-85fd-00d15bd4d7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089929 Oct 19 13:33:03.184879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 968/1865] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:03.312256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:03.312900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:03.319459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:03.319943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:03.320377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:03.321113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:03.321574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:03.321971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:03.460763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:03.470010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aed6e54c-1584-4f92-8d70-ec51748588bb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161532 Oct 19 13:33:03.470195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 898/1866] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:03 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:04.162823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:04.163680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:04.172207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.172686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.173154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.173845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.174289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.174708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.209918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:04.210578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:04.218060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.218596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.219025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.219731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.220176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.220585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.290234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:04.299320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:04.300782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:04.302135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3a54e872-4baf-47b6-8e9a-cc97afc89465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096105 Oct 19 13:33:04.302825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 899/1867] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:04.319546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:04.328379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6ad164ad-d79c-4f82-bf3f-da4fc977a8a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169953 Oct 19 13:33:04.328977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 969/1868] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:04.496935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:04.497441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:04.504385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.504951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.505381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.506065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:04.506512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:04.506939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:04.642353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:04.651287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cce5e210-0e21-4284-8737-d126ff909cf9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159309 Oct 19 13:33:04.651904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 900/1869] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:05.328142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:05.328759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:05.335968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.336453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.336893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.337615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.338065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.338489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.351759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:05.352432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:05.359039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.359545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.359967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.360671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.361193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.361554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.408798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:05.412591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:05.426272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:05.427747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:05.428941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-36a4b18b-e370-4499-b2d3-3b4aeb08db14 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105294 Oct 19 13:33:05.429506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 970/1870] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:05.504307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:05.517967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1dd05748-61c6-4fb8-b5e1-ff096a597fe1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169821 Oct 19 13:33:05.518845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 901/1871] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:05.675118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:05.675598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:05.682313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.682799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.683233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.684075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:05.684684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:05.685155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:05.820490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:05.832432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8f96939d-7b5d-4071-977a-e90ab5d9ccc5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161148 Oct 19 13:33:05.833369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 971/1872] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:06.454039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:06.454633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:06.461729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.462201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.462624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:06.463302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.463741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.464149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:06.530862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:06.540124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:06.541600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:06.542733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a47ae3ee-ff2a-4d77-8fcb-5ef382b543f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092666 Oct 19 13:33:06.543642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 902/1873] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:06.544433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:06.545097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:06.551762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.552235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.552666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:06.553385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.553807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.554219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:06.691767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:06.700359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e441e862-38ab-4fd3-8a2c-b2d17bd0d82a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159816 Oct 19 13:33:06.700946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 972/1874] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:06.860189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:06.861210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:06.871427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.871959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.872384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:06.873159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:06.873616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:06.874035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:07.032895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:07.041559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9fb0630-4911-47a3-b56c-0adbb8de410d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.188067 Oct 19 13:33:07.042120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 903/1875] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:06 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:07.568836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:07.569448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:07.579506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:07.580353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:07.580703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:07.581435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:07.581881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:07.582300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:07.650787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:07.660193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:07.661654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:07.662854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e7c81e86-1e28-46d6-a1c2-7e8ccc7f715e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098159 Oct 19 13:33:07.664082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 973/1876] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:07.723998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:07.724643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:07.731498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:07.731979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:07.732410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:07.733136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:07.733583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:07.734006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:07.875051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:33:07.875299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:33:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa (ip 10.222.0.17) !!! Oct 19 13:33:07.886824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:07.896391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-58d71857-dec1-4fa6-bc94-32359aa82685 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.176314 Oct 19 13:33:07.897011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 904/1877] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:08.071465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:08.072076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:08.079166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.079568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.080006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:08.080715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.081207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.081653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:08.218671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:08.227379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9de1d3a-76e9-4d03-9a20-7b5971c92dbc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159868 Oct 19 13:33:08.227972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 974/1878] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:08.688238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:08.688836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:08.695872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.696350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.696802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:08.697498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.698297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.698750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:08.766032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:08.774977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:08.776396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:08.777547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-42f8e550-cbce-45f1-bca6-48d421b29856 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093503 Oct 19 13:33:08.778100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 905/1879] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:08.920905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:08.921523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:08.928474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.928989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.929425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:08.930118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:08.930576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:08.931003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:09.063472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:09.072023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-434918fb-aac9-41ff-9eff-28128af8d110 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155527 Oct 19 13:33:09.072618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 975/1880] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:09.251884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:09.252484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:09.259228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:09.259703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:09.260126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:09.260806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:09.261281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:09.261690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:09.391818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:09.400688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e9ad701e-bb98-4bcb-bec6-9347cf3a0fdb tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.153142 Oct 19 13:33:09.401306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 906/1881] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:09 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:09.802525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:09.803133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:09.810020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:09.810376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:09.810806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:09.811498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:09.811937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:09.812353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:09.874280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:09.883856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:09.885404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:09.886558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a283b108-4e30-4571-8464-20a21d05a7c1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088032 Oct 19 13:33:09.887130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 976/1882] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:10.096952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:10.097530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:10.104453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.104959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.105391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.106091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.106757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.107592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.239808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:10.242180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:10.250279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-70849ff6-76cb-4c85-a0ce-cb3a053f5494 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157437 Oct 19 13:33:10.250832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 907/1883] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:10.424770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:10.426066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:10.433204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.433698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.434134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.435028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.435464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.435892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.571561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:10.580395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1190787-cad3-4da9-bc2e-787948775993 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159564 Oct 19 13:33:10.580953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 977/1884] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:10.912400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:10.913031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:10.919639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.920119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.920550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.921292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:10.921735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:10.922150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:10.988234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:10.997405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:10.998826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:11.000306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-96e5dde4-cdb8-4242-a2ab-f80921a7c95f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092188 Oct 19 13:33:11.000885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 908/1885] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:11.274555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:11.275157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:11.281755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:11.282281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:11.282703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:11.283398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:11.283849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:11.284295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:11.416304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:11.425624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d5f45c8-e121-4b1d-af28-0b3db39d634f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155057 Oct 19 13:33:11.426249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 978/1886] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:11.603897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:11.604510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:11.611388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:11.611862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:11.612287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:11.613004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:11.613478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:11.613887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:11.745452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:11.755031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2e07b26c-03fc-4079-b3f1-11fe2f6015a3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.155107 Oct 19 13:33:11.755599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 909/1887] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:12.025274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:12.025899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:12.032979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.033461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.033889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.034575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.035020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.035559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.098985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:12.108613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:12.110087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:12.111252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e41c68cc-149c-4725-baab-f6a72914df0f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089995 Oct 19 13:33:12.111819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 979/1888] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:12.448851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:12.449478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:12.455923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.456406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.456835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.457549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.458165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.458615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.589942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:12.599089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-30ac54ea-60b0-456b-bcb6-806af0918fa1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154322 Oct 19 13:33:12.599661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 910/1889] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:12.779781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:12.780378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:12.788058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.788695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.789164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.790045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:12.790693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:12.791270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:12.926720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:12.935344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-259b65c9-7e95-4f19-bb89-8903ad217d97 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159538 Oct 19 13:33:12.935915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 980/1890] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:13.137127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:13.138179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:13.144740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.145248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.145743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:13.146746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.147423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.148047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:13.226976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:13.236307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:13.237767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:13.238906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f3ecbb9b-5b99-4470-843b-171db43dd9f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105902 Oct 19 13:33:13.239476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 911/1891] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:13.623520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:13.624115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:13.626832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:13.632257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.632738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.633196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:13.633887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.634337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.634756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:13.768624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:13.777017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f643ee3f-745c-4fe1-befc-5a6b4d3043e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157516 Oct 19 13:33:13.777648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 981/1892] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:13.959466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:13.959983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:13.966768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.967232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.967655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:13.968337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:13.968775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:13.969221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:14.103803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:14.112387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f76be070-bf02-4b29-baf4-bf0f9a1d034a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.156901 Oct 19 13:33:14.112985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 912/1893] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:13 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:14.265920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:14.266577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:14.272905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:14.273409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:14.273842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:14.274527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:14.274981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:14.275400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:14.338005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:14.347011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:14.348597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:14.349768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-37138052-0f85-4d45-8e29-ee56582e2be1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088646 Oct 19 13:33:14.350330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 982/1894] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:14.802260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:14.803121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:14.812159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:14.812634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:14.813098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:14.813782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:14.814220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:14.814661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:14.946830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:14.955285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-291a8c4c-b751-484e-b370-39f65878b726 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159169 Oct 19 13:33:14.955816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 913/1895] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:15.136377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:15.136962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:15.144228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.144706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.145170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:15.145977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.146440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.146834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:15.285241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:15.294128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-27338333-abfd-4bd2-8cbb-1bfed4c5ba23 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161450 Oct 19 13:33:15.294966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 983/1896] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:15 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:15.375650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:15.376389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:15.382930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.383410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.383824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:15.384514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.384989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.385402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:15.451014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:15.459819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:15.461278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:15.462415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-95810414-d8c1-4722-84e1-3e6274cd1acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091188 Oct 19 13:33:15.462980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 914/1897] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:15.979060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:15.979667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:15.986187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.986663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.987091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:15.987777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:15.988222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:15.988664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:16.117088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:16.126576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eead33bc-ba66-4ca3-a9bf-89e46601c3a2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.151479 Oct 19 13:33:16.127138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 984/1898] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:16.319133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:16.319750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:16.322196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=80 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:16.328194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:16.328696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:16.329141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:16.329845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:16.330293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:16.330709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:16.464600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:16.473572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-706fb0b6-1868-4ba7-b4de-2b27f50babd6 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158358 Oct 19 13:33:16.474148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 915/1899] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:16.488211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:16.488792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:16.495706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:16.496184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:16.496611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:16.497695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:16.498051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:16.498504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:16.561334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:16.570215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:16.571560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:16.572696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-413bcf35-0291-43a5-bb3a-e797424a6059 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088534 Oct 19 13:33:16.573293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 985/1900] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:17.150915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:17.151510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:17.158198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.158677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.159100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.159794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.160232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.160644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.301893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:17.310876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dc641767-ca8a-4f55-8b12-2fac347b328c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164029 Oct 19 13:33:17.311451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 916/1901] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:17.500067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:17.500633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:17.507504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.507994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.508419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.509155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.509610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.510033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.598148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:17.598784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:17.605532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.606018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.607035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.607618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:17.608072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:17.608518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:17.647283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:17.655906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-81a3eefa-7976-4f4a-b31b-a7930dfcb43f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161869 Oct 19 13:33:17.656583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 986/1902] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:17.677260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:17.686469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:17.687900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:17.689094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-20dc2076-596f-415c-9073-c762e00d75f5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095063 Oct 19 13:33:17.689658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 917/1903] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:18.334141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:18.334751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:18.341100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.341584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.342011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.342750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.343252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.343671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.358795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:18.474515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:18.483992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-588c13c6-2b95-4c10-aaa1-6be685fb266f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153784 Oct 19 13:33:18.484573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 987/1904] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:18.680175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:18.680775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:18.688202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.688761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.689190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.689902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.690495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.690901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.718364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:18.718983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:18.726084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.726910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.727495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.728208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:18.728660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:18.729105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:18.797797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:18.815910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:18.817371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:18.818534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e278abb3-2d25-4b6b-b501-57e62aa4a018 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.106164 Oct 19 13:33:18.819092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 988/1905] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:18.849366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:18.860338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a15253b7-f772-43de-9252-2e95b63e928c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.183841 Oct 19 13:33:18.860953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 918/1906] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:19.514256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:19.514860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:19.521444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.521922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.522349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.523032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.523476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.523890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.670340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:19.679168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-96eb927c-8206-4516-8723-f6b69db62fd4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.168817 Oct 19 13:33:19.679762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 989/1907] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:19.844900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:19.845642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:19.855177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.855657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.856375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.857749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.858015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.858582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.887473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:19.888079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:19.894362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.894840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.895268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.895961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:19.896436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:19.896847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:19.931328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:19.940833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:19.942278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:19.943459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-94c1933d-5416-4bfd-8fed-66570269894d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103374 Oct 19 13:33:19.944026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 919/1908] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:20.034350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:20.043098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b2b3da2-4fcb-4568-9b22-4633d92d9f76 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159683 Oct 19 13:33:20.043753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 990/1909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:19 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:20.704500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:20.705036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:20.712741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:20.713339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:20.713748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:20.714489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:20.714940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:20.715386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:20.862756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:20.875218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2eaf5b60-8932-4972-aec6-b240f6c25f73 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174599 Oct 19 13:33:20.875942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 920/1910] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:20.971278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:20.972089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:20.982378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:20.982856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:20.983284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:20.983997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:20.984446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:20.984882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:21.055925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:21.065788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:21.066375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:21.066974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:21.067190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:21.068367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b91cf50d-f47d-4c05-914b-8b4f1502621a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102297 Oct 19 13:33:21.068917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 991/1911] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:21.074045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:21.074512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:21.074949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:21.075711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:21.076128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:21.076686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:21.224943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:21.234841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c9d41d46-019f-4a72-8afe-617e26cacf83 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172158 Oct 19 13:33:21.235552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 921/1912] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:21.902149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:21.902796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:21.909702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:21.910194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:21.910625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:21.911322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:21.911771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:21.912187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:22.045273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:22.053828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f9412147-fd43-4e5e-ab21-33c344f75d51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155618 Oct 19 13:33:22.054387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 992/1913] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:22.095311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:22.095930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:22.102878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:22.103355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:22.103778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:22.104464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:22.104897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:22.105344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:22.172550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:22.181491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:22.182898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:22.184022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2084d71-d0d1-49dd-951f-d12c0f017f9d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093714 Oct 19 13:33:22.184855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 922/1914] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:22.259398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:22.260010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:22.266745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:22.267225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:22.267649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:22.268344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:22.268786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:22.269236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:22.402302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:22.414004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ed581a67-b95b-4bab-aa08-76e15be6395e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158404 Oct 19 13:33:22.414592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 993/1915] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:22 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:23.078292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:23.078898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:23.085465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.085936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.086361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.087039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.087481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.087892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.209710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:23.210510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:23.217291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.217908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.218446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.219388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.219934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.220470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.229107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:23.239047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6cf9e4f0-5852-46b4-bf32-8a106ce9f2a3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164985 Oct 19 13:33:23.239617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 923/1916] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:23.291209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:23.300170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:23.301629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:23.302771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4bb4787f-ed75-407a-93af-b07b1a21663f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097667 Oct 19 13:33:23.303328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 994/1917] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:23.439564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:23.440057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:23.446529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.447003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.447420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.448098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:23.448533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:23.448976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:23.464338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:23.581816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:23.590332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5f25b155-c233-4d9b-bc21-8d9101f68faf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.154770 Oct 19 13:33:23.590882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 924/1918] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:24.262962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:24.263548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:24.270517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.270998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.271426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.272114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.272558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.273001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.328173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:24.328897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:24.335984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.336650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.337195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.337966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.338481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.338887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.401121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:24.410239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:24.414500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:24.415936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:24.417099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0a84a78b-a840-4bd2-ac51-c4a9e4222dc1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093315 Oct 19 13:33:24.417662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 925/1919] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:24.418657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4423a42-5a49-4022-aaff-ed0cd8a782ae tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159805 Oct 19 13:33:24.419215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 995/1920] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:24.613908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:24.614501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:24.621044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.621520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.621986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.622844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:24.623307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:24.623725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:24.759168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:24.767852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-adb66529-8743-4942-9b13-fad539a135f3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.158046 Oct 19 13:33:24.768412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 926/1921] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:25.443233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:25.443879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:25.445648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:25.446330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:25.450885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.451415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.451900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.452603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.453099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.453274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.453521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.453665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.454078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.454899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.455338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.455750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.516794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:25.525936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:25.528082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:25.529289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d3648512-2812-4f6b-a69b-f551befe450a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090279 Oct 19 13:33:25.530029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 996/1922] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:25.590562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:25.599365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-08b76beb-1d21-44c3-8a7f-ab8fd78de158 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158207 Oct 19 13:33:25.599938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 927/1923] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:25.794874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:25.795752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:25.805831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.806553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.807210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.808293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:25.809183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:25.809676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:25.954756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:25.963286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0bcea7e6-3304-4fcd-8cc7-a281b9f5ca2d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175360 Oct 19 13:33:25.963856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 997/1924] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:25 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:26.556001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:26.556563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:26.563963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.564444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.564908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:26.565620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.566041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.566458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:26.625248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:26.625933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:26.633290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.633782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.634225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:26.635021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.635632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.635772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:26.638081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:26.647735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:26.649241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:26.650385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4fcf2875-ad28-4a75-b7ad-9dcb3dadd3ba tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098494 Oct 19 13:33:26.650930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 928/1925] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:26.775727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:26.787286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e399c5dc-a9ba-413b-b045-b9b8d1ff21d4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166488 Oct 19 13:33:26.788060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 998/1926] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:26.988819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:26.989361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:26.995911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.996426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.996930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:26.997741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:26.998192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:26.998613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:27.144497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:27.155771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ecd49584-558b-44cc-bd1d-8671a6f9113d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170978 Oct 19 13:33:27.156340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 929/1927] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:27.678695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:27.679243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:27.688058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:27.688551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:27.689021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:27.689723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:27.690178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:27.690597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:27.753661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:27.763104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:27.764560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:27.765750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a6edc98d-8008-4f12-9320-cda4b1a09ec9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093448 Oct 19 13:33:27.766307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 999/1928] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:27.811893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:27.812475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:27.819578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:27.820058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:27.820488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:27.821217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:27.821662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:27.822075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:27.955984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:27.965462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b6ad33e-3890-4714-8411-b672e8b702c6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158058 Oct 19 13:33:27.966047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 930/1929] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:28.182708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:28.183319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:28.191013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:28.191727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:28.192391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:28.193653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:28.194364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:28.195038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:28.347156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:28.358031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-95ef480d-f7a7-4ce3-8378-0ca3136bd000 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.179336 Oct 19 13:33:28.358594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1000/1930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:28 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:28.791534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:28.792123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:28.801042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:28.801832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:28.802526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:28.803649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:28.804381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:28.805098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:28.878956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:28.888568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:28.889992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:28.891288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e2032a3f-20b4-41a5-b9dc-d59d5314e3dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103620 Oct 19 13:33:28.891899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 931/1931] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:28.989893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:28.990485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:29.000325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.001357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.002126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.003149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.004034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.004801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.146822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:29.159493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7d1ac229-66e2-4772-accc-f1aad4e5c008 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173409 Oct 19 13:33:29.160264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1001/1932] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:29.382630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:29.383147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:29.390262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.390745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.391175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.392048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.392493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.392988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.529924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:29.540178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7ef2ed1a-03b5-40c6-a4c5-b2351563e207 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161694 Oct 19 13:33:29.540764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 932/1933] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:29.920991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:29.921601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:29.928468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.928962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.929391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.930112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:29.930524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:29.930971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:29.995317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:30.005786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:30.007221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:30.008366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f2c13048-2a6d-4a56-a7e5-9581db79c705 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092479 Oct 19 13:33:30.008924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1002/1934] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:33:30.188205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:30.188791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:30.195753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:30.196236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:30.196661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:30.197400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:30.197850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:30.198270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:30.345227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:30.354612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-47f46d24-69d2-48b8-92d9-b2acec497544 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.171068 Oct 19 13:33:30.355522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 933/1935] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:30.567254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:30.567861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:30.574351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:30.574946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:30.575384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:30.576084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:30.576660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:30.577221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:30.724386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:30.735131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-62843890-3364-4c4a-974e-41666dfd5e11 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172266 Oct 19 13:33:30.735719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1003/1936] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:30 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:31.034885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:31.035493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:31.041976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.042545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.042945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.043738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.044455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.044953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.113690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:31.123189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:31.125399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:31.126388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07ebaf1a-3046-450c-aad2-e0165c829360 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095513 Oct 19 13:33:31.127020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 934/1937] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:31.379724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:31.380312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:31.387656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.388148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.388701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.389444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.389906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.390335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.393226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:31.526530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:31.535104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bb273179-cba7-417c-89ed-c96ebc784a1d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159295 Oct 19 13:33:31.535683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1004/1938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:31.759359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:31.759997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:31.762436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:33:31.762605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 (ip 10.222.0.17) !!! Oct 19 13:33:31.769964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.770468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.770894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.771585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:31.772028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:31.772463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:31.917267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:31.925945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1495e4ed-1269-48e6-8844-437728793dab tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170607 Oct 19 13:33:31.926489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 935/1939] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:32.154196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:32.154813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:32.161763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.162257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.162697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:32.163415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.163873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.164298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:32.232182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:32.241654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:32.243081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:32.244235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a312baec-0876-4c25-b135-37498bf82ba1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094194 Oct 19 13:33:32.245889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1005/1940] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:32.559173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:32.559912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:32.566527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.567011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.567434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:32.568106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.568544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.569021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:32.712282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:32.721565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-59f0ae60-a89e-4ea9-894a-9bbe7dad35bc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166815 Oct 19 13:33:32.722734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 936/1941] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:32.952425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:32.953081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:32.960263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.960753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.961218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:32.962175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:32.962631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:32.963060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:33.111607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:33.121224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8a422883-604d-4e70-ad16-b809b325faf0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174671 Oct 19 13:33:33.121786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1006/1942] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:33.270981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:33.271676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:33.281115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:33.281692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:33.282125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:33.282840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:33.283288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:33.283719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:33.354701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:33.365260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:33.366695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:33.367863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-89e658b1-90fc-48f2-9e26-cf6433b2e8b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101421 Oct 19 13:33:33.368428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 937/1943] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:33.748714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:33.749710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:33.756278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:33.756801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:33.757271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:33.757998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:33.758428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:33.758847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:34.063507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:34.075075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f2786808-020a-4e0b-92d9-76f2e9b0872d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.332527 Oct 19 13:33:34.076503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1007/1944] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:34.146443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:34.147055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:34.154179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:34.154598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:34.155032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:34.155757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:34.156199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:34.156613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:34.310922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:34.320297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-28e2cb75-8568-4b4d-b562-ab02c8d435e5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.177846 Oct 19 13:33:34.321094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 938/1945] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:34 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:34.396051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:34.396737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:34.404267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:34.404762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:34.405131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:34.405780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:34.406266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:34.406568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:34.478235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:34.489813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:34.491214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:34.492485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a7f43c82-a9bc-4e99-bc70-ce338bbb0165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101464 Oct 19 13:33:34.493159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1008/1946] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:35.107857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:35.108142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:35.114580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.115058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.115481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.116163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.116616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.117057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.255349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:35.267887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-617c9310-17b5-4768-96b7-60b6220a4f57 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165251 Oct 19 13:33:35.268586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 939/1947] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:35.346373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:35.346990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:35.354461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.354931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.355426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.356080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.356597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.357068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.495332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:35.505014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-840ef8f8-8560-4dc9-9f96-0b792cb70fa5 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163203 Oct 19 13:33:35.505606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1009/1948] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:35.519054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:35.519676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:35.529536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.530013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.530547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.531266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:35.531712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:35.532123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:35.600794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:35.610473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:35.611944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:35.613139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5143ff7c-7413-4259-bb8c-96ed4f19ee4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098413 Oct 19 13:33:35.613701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 940/1949] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:36.296620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:36.297793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:36.306640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.307121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.307549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.308320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.308822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.309321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.443050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:36.451604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6bf9706a-0fb5-4af2-a1e5-9649ea842e4a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161094 Oct 19 13:33:36.452162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1010/1950] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:36.528326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:36.529489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:36.536233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.536723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.537182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.537882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.538327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.538768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.541441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:36.637784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:36.639126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:36.645987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.646485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.646923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.647621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:36.648072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:36.648495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:36.674816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:36.683706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ed78a1f9-ad9d-4bae-9ad3-8cdbf95f9eff tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159281 Oct 19 13:33:36.684291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 941/1951] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:36 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:36.715031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:36.724243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:36.725683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:36.727213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5cbb7e47-e5ee-4e96-80a6-4010c3a7c4ff tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093428 Oct 19 13:33:36.727799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1011/1952] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:37.477529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:37.478272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:37.488959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.489863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.490472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.491286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.492026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.492568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.634697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:37.644037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c39d44f-6c38-4e8b-b19b-5bf3ec474c51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.172108 Oct 19 13:33:37.644617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 942/1953] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:37.708811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:37.709425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:37.717424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.717993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.718533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.719241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.719684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.720107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.752539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:37.753418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:37.760312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.761035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.761839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.762905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:37.763379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:37.763797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:37.836334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:37.846499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:37.848267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:37.849636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b35ae90c-c841-4df5-b329-4b0e15c4284e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101714 Oct 19 13:33:37.850686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 943/1954] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:37.874506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:37.886747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8d32278b-64f5-47b5-8b05-5bf0c23a3b16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.182607 Oct 19 13:33:37.887892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1012/1955] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:38.670970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:38.671766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:38.679268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.679738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.680352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.681105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.681547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.681956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.830364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:38.839417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-983977dd-ffb0-42bb-9940-a1354213b563 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173851 Oct 19 13:33:38.839989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 944/1956] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:38.875532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:38.876145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:38.883108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.883625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.884057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.884756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.885231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.885646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.911592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:38.912236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:38.918481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.918959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.919381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.920075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:38.920512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:38.920941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:38.953164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:38.962331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:38.963900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:38.965214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3769805d-a216-4ca7-b795-5dd46e410c3d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094004 Oct 19 13:33:38.966050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1013/1957] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:39.055381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:39.064106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-815aea3a-4299-456b-8917-6b4f60ff530a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157261 Oct 19 13:33:39.065426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 945/1958] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:38 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:39.863574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:39.864186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:39.870947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:39.871545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:39.871892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:39.872598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:39.873112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:39.873536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:39.993289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:39.993896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:40.001633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:40.002030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:40.002847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:40.003697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:40.004154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:40.004585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:40.017393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:40.026441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1a5bc8a0-62e3-4bec-b190-a9e1be675703 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167268 Oct 19 13:33:40.027245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1014/1959] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:40.076474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:40.086783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:40.087591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:40.088213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:40.088592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:40.089461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5f30aea4-fb44-413e-b61b-089eb59199c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100353 Oct 19 13:33:40.090272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 946/1960] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:33:40.095286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:40.096005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:40.096897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:40.097882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:40.098832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:40.099658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:40.239161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:40.251263 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d08bbf2e-69d8-4fc2-a8fd-a11b6ef3b3f0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167322 Oct 19 13:33:40.252094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1015/1961] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:40 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:41.051894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:41.052522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:41.059714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.060187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.060609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.061334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.061776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.062187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.118236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:41.118925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:41.129041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.129845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.130575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.131762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.132713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.133228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.213253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:41.222943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:41.224371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:41.225564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52703116-b6bf-4082-a0f8-dd1a9bd7eafe tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.111633 Oct 19 13:33:41.226119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1016/1962] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:41.286605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:41.287285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:41.294982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.295595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.297954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.297954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:41.297954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:41.301279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:41.405504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:41.415337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd7c1ab3-3d2d-4719-b706-8b26d364b4af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.368162 Oct 19 13:33:41.415920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 947/1963] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:41.457627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:41.466551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0754e142-95c4-4b1c-b889-e41aa1f5f00b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.184686 Oct 19 13:33:41.467131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1017/1964] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:41 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:42.252397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:42.253262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:42.260462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.261261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.261954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.263019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.263655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.264216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.334220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:42.346113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:42.348367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:42.349951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c65d4fde-d241-4d2b-96e8-c10232e61390 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102158 Oct 19 13:33:42.350710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 948/1965] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:42.445388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:42.451093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:42.458945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.459728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.460471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.461700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.462382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.462895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.490793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:42.491406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:42.497984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.500756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.500756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.500756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:42.500756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:42.501144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:42.602439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:42.613654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c83f466c-1989-4463-b490-455348ce93a9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.175631 Oct 19 13:33:42.614269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1018/1966] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:42.640047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:42.649161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8263f0d-31a4-4aa9-9660-6a119a9c8c68 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162727 Oct 19 13:33:42.649700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 949/1967] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:42 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:43.379141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:43.379762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:43.387091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.387291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.387730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.388430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.388890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.389329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.461967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:43.474339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:43.475747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:43.476908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74669b22-abe1-4aa0-a0aa-9654d92c9f95 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101972 Oct 19 13:33:43.477488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1019/1968] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:43.638856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:43.639419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:43.648188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.648773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.649371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.650385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.651158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.651658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.673874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:43.674504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:43.676763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:43.682034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.682525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.682960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.683655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:43.684099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:43.684518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:43.792885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:43.801927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86122290-63fa-4354-a2f2-5812f0b212b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167897 Oct 19 13:33:43.802446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 950/1969] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:43.824028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:43.826241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:43.834314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dac3880a-6e68-4df1-9e9e-37f5a94e59af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164307 Oct 19 13:33:43.834885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1020/1970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:43 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:44.506122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:44.506718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:44.513904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.514492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.515152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.516207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.516941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.517647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.584376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:44.594896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:44.596315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:44.597485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-560bc08f-4072-472e-aca0-8f8fdfe3931f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095672 Oct 19 13:33:44.598049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 951/1971] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:44.825527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:44.826188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:44.833292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.833839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.834312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.835012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.835467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.835884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.860743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:44.861449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:44.868694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.869241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.869647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.870351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:44.871059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:44.871200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:44.984239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:44.993282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e05f7a64-1b09-4b1a-8b22-f10d6908d712 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.171644 Oct 19 13:33:44.993771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1021/1972] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:45.022547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:45.031009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8b6dcacd-0b9e-4ef1-96c7-9f8e85e7f215 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.174680 Oct 19 13:33:45.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 952/1973] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:45.630090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:45.630757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:45.637210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:45.637696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:45.638135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:45.638840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:45.639293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:45.639720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:45.702294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:45.715181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:45.717283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:45.718813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c5e2ca16-4a1b-49ac-818a-6a4511ab76db tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093257 Oct 19 13:33:45.719602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1022/1974] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:46.021481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:46.022276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:46.029219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.029700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.030128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.030818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.031262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.031680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.054562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:46.055179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:46.061951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.062685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.063402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.064501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.065202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.065877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.173500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:46.183059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3e00012f-f68e-4414-97ac-292ba40b42b8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167958 Oct 19 13:33:46.183628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 953/1975] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:46.215312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:46.227729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e3904fa6-fb28-4837-a07f-4be428e7118b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176955 Oct 19 13:33:46.228494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1023/1976] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:46 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:46.744801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:46.745342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:46.747289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=78 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:46.753205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.753678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.754105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.754826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:46.755274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:46.755821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:46.825181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:46.837000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:46.838443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:46.839594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-33c3b88a-243b-4657-81b0-44e2c850ec98 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099068 Oct 19 13:33:46.840144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 954/1977] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:47.207255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:47.207893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:47.214830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.215307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.215739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.216426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.216900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.217323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.252309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:47.253037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:47.260321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.260899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.261389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.262269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.262745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.263184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.351811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:47.364152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e054a8d2-eb50-4bc5-8bd8-f727de6f9080 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160583 Oct 19 13:33:47.364853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1024/1978] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:47.407926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:47.417179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-403841b0-0c02-4a4c-b728-494984df872e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169147 Oct 19 13:33:47.417773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 955/1979] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:47 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:47.869642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:47.870679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:47.881325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.881977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.882500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.883478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:47.883986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:47.884453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:47.961771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:47.974908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:47.976547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:47.977736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-72def0b4-8d3f-4e45-b7df-4ea6efe5d300 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.115170 Oct 19 13:33:47.978308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1025/1980] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:48.399126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:48.399756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:48.406963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:48.407447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:48.407876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:48.408607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:48.409094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:48.409543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:48.441991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:48.442766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:48.451071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:48.451071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:48.451071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:48.452163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:48.452163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:48.452538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:48.557593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:48.566499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-391376ff-0dac-47cb-a2aa-ac420c2a1f00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.172509 Oct 19 13:33:48.567147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 956/1981] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:48.599278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:48.608820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a39de7bf-9983-468b-b252-a3e445b896de tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170727 Oct 19 13:33:48.609412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1026/1982] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:48 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:49.007860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:49.009907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:49.020419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.021282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.021982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.023157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.024063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.024683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.101775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:49.103990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:49.112400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:49.113852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:49.114986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af85840d-1474-41a8-9f97-b749d72458f1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.114043 Oct 19 13:33:49.115557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 957/1983] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:49.592380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:49.593100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:49.599852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.600671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.601494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.602587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.603464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.604188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.642505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:49.643118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:49.652221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.652714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.653149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.653856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:49.654319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:49.654738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:49.747936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:49.756814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1a58c83f-9f9e-401c-a186-d783a33d979e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169492 Oct 19 13:33:49.757452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1027/1984] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:49.792436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:49.800652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee6777d9-2145-4c40-864f-8752e765f0bc tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163514 Oct 19 13:33:49.801243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 958/1985] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:49 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:50.141351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:50.141961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:50.148437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.148938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.149377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.150102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.150578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.151006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.218046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:50.230664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:50.232088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:50.233264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-79f9f559-7963-4fd2-8e98-d7cfefbef465 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095968 Oct 19 13:33:50.233795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1028/1986] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:50.780218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:50.780886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:50.787939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.788366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.788774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.789483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.789915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.790324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.824434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:50.825079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:50.831875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.832357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.832794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.833517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:50.833969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:50.834416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:50.924572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:50.933307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e5939914-8ff1-4597-bdb6-dea08f5f5812 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156967 Oct 19 13:33:50.933887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 959/1987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:50.963440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:50.971786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2f9c68e6-73db-4f98-a733-e26ce0654a16 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.151788 Oct 19 13:33:50.972356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1029/1988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:50 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:51.268665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:51.269303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:51.275694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:51.276173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:51.276640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:51.277371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:51.277803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:51.278223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:51.353296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:51.362582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:51.364012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:51.365197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd30dfd7-1c50-43d6-b9f3-e63a2583b131 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100620 Oct 19 13:33:51.365766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 960/1989] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:51.957157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:51.957758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:51.964980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:51.965469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:51.965899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:51.966598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:51.967048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:51.967466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:51.994888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:51.998233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:52.003220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:52.003702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:52.004191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:52.004885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:52.005330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:52.005742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:52.110612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:52.119406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0dd32bb0-121f-4499-8071-b0b85dd643e9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166182 Oct 19 13:33:52.119996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1030/1990] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:52.144299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:52.153932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e586240f-a958-4591-89a5-1f92c98ea85f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162964 Oct 19 13:33:52.154488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 961/1991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:52.393316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:52.393924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:52.400644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:52.401142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:52.401632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:52.402340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:52.402787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:52.403209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:52.473587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:52.482889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:52.484309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:52.485513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4187f3fb-57f8-4c27-b263-6e17dfed58d5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096272 Oct 19 13:33:52.486104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1031/1992] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:53.144406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:53.145114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:53.152780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.153451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.153919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.154627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.155188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.155605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.178476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:53.179095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:53.186687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.187182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.187619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.188351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.188775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.189223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.297899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:53.306778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-997ce26c-6854-4171-bde6-7efe451633cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166495 Oct 19 13:33:53.307505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 962/1993] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:53.332100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:53.341768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9abcda03-8c21-4872-807a-94d47dbc4f75 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167163 Oct 19 13:33:53.342382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1032/1994] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:53 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:53.512674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:53.513626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:53.520453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.521109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.521605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.522308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:53.522751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:53.523170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:53.599414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:53.610477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:53.612275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:53.613759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a540aabd-bac0-421e-ab99-625ca33fd363 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105752 Oct 19 13:33:53.614498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 963/1995] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:54.333090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:54.334017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:54.342483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.342962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.343390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.344079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.344525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.344969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.368674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:54.369361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:54.376797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.377323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.377754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.378468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.378911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.379332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.476812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:54.486881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-414fe244-e5a9-478f-8183-9f4824054dff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159523 Oct 19 13:33:54.487477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1033/1996] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:54.521727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:54.531622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aeff1f02-871f-4a51-b9ce-c28c61cc803b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168027 Oct 19 13:33:54.532205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 964/1997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:54 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:54.640995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:54.641502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:54.648113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.648601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.649053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.649746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:54.650223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:54.650620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:54.718416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:54.727901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:54.729357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:54.731001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f52c3c4a-6957-4caf-aee3-5e19875c0668 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094010 Oct 19 13:33:54.731633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1034/1998] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:55.511604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:55.512355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:55.519659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.520145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.520570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.521298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.521742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.522157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.560206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:55.560816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:55.568003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.568413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.568850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.569587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.570037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.570461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.655304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:55.663950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3ccf0a8c-ab71-448a-a75b-d1a8564d192d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156508 Oct 19 13:33:55.664761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 965/1999] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:55.704794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:55.713101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e68d34c2-020e-4f40-a98f-74a064bf2b12 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157504 Oct 19 13:33:55.713670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1035/2000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:55 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:55.762806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:55.763742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:55.772777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.773580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.774186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.775246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:55.775941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:55.776725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:55.841409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:55.850123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:55.851543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:55.852679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d3b12538-5cdd-41e5-98c2-a1904e80b734 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096940 Oct 19 13:33:55.853267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 966/2001] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:56.693531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:56.694389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:56.703042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.703525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.703961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.704656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.705146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.705572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.735859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:56.736586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:56.743417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.743896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.744323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.745042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.746116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.746719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.837235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:56.846594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cbab68c0-2a78-4cc4-9e84-e9df5c4d357f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159845 Oct 19 13:33:56.847586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1036/2002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:56.877924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:56.878511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:56.880379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:56.884556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.885062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.885498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.886427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:56.886880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:56.887300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:56.889173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad683827-fc21-4f54-94ea-a4a7e453ea6c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157237 Oct 19 13:33:56.889761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 967/2003] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:56.902135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:33:56.952426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:56.965536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:56.967664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:56.969388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-da0d9331-6057-45a2-9a49-cae851e284d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095577 Oct 19 13:33:56.969940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1037/2004] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:57.873741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:57.874420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:57.881642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:57.882144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:57.882587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:57.883316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:57.883783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:57.884217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:57.913044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:57.913788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:57.924890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:57.925383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:57.925821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:57.926531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:57.926981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:57.927410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:58.020597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:58.029587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-323a0fdc-14cc-41c8-9367-7e4009f28e8e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161235 Oct 19 13:33:58.030251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 968/2005] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:58.034681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:58.035280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:58.041118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:58.041592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:58.042023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:58.042709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:58.043152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:58.043600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:58.059877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:58.068176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d5621e7c-33d4-4bfa-b2cf-d65a6b867546 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159186 Oct 19 13:33:58.068741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1038/2006] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:33:58.110943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:58.120074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:58.121712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:58.122864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-53608c1f-2fc5-49fa-9486-6fc11a060583 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091745 Oct 19 13:33:58.123898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 969/2007] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:33:59.057308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:59.058255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:59.069401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.070192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.070903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.072039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.072785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.073530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.091893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:59.092477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:59.099517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.100002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.100431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.101173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.101635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.102052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.206508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:59.214872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb21b428-8300-41e4-bd44-29ad556912f5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164084 Oct 19 13:33:59.215467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1039/2008] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:59.220216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:33:59.220796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:33:59.230411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.231349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.231790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.232508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:33:59.233209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:33:59.233638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:33:59.237158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:59.245514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bbba2af8-8209-4df5-95ae-e7f51e3f3fbf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157591 Oct 19 13:33:59.246056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 970/2009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:33:59 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:33:59.306921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:59.316469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:59.317943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:33:59.319099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ac4792e2-874a-4da6-a6af-c97782c11621 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102708 Oct 19 13:33:59.319622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1040/2010] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:33:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:00.238739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:00.239377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:00.246345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.246819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.247242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.247957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.248739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.249185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.269151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:00.269743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:00.276568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.277117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.277891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.278652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.279116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.279541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.388438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:00.396958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dc2a9169-4a44-4139-92d6-18726c24826b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162088 Oct 19 13:34:00.397545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 971/2011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:00.403100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:00.403347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:00.409319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.409880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.410290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.410976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:00.411449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:00.411874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:00.421169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:00.429368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b0e3a18e-c75a-488a-b5e7-a924eb84db1d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164073 Oct 19 13:34:00.429935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1041/2012] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:00.479590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:00.488705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:00.490277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:00.491334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0d7319c5-9de5-48fd-9fb7-760c2dfb7a5d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092851 Oct 19 13:34:00.491862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 972/2013] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:01.425582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:01.426332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:01.435134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.435754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.436299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.437177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.437713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.438235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.453678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:01.454237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:01.461384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.461825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.462228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.462953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.463384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.463797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.574198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:01.583700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb57a903-9088-45ba-ab60-e0bc961d2998 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163097 Oct 19 13:34:01.584323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1042/2014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:01.590251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:01.590914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:01.598223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.598697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.599207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.599989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:01.600321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:01.600742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:01.602923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:01.612202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f3eaaa18-4a01-4da7-83b3-fa08069df1dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162388 Oct 19 13:34:01.612843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 973/2015] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:01 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:01.665123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:01.674482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:01.675893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:01.677052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2c916171-c52a-41f0-b842-825fd76b4246 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091094 Oct 19 13:34:01.677610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1043/2016] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:02.611681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:02.612481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:02.622058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.622537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.622964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.623992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.624437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.624852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.635831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:02.636512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:02.640582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:02.643932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.644417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.644907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.645576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.646023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.646437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.760210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:02.769025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-90785151-b6bb-4476-82bd-a4ad8049411c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163465 Oct 19 13:34:02.769617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 974/2017] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:02.774262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:02.774864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:02.781798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.782569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.783172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.784666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:02.785306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:02.785924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:02.854644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:02.864769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:02.866162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:02.867319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d61b9596-5c71-483a-a08a-b0d805b1a792 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096789 Oct 19 13:34:02.867875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 975/2018] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:03.021328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:03.029765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-072b435d-fe9d-451f-be5a-58e357fbdd53 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.397815 Oct 19 13:34:03.030312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1044/2019] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:03.796015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:03.796753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:03.805324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.805928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.806462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.807320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.807872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.808993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.893605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:03.894225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:03.901254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.901813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.902401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.903117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:03.903566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:03.903985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:03.951509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:03.960089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-39120233-41bb-4f25-91a5-457bc1ffa90b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169724 Oct 19 13:34:03.960658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 976/2020] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:03.966470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:03.975153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:03.976576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:03.977813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-13aeadad-0ade-4740-a7b9-6c471eb64179 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088176 Oct 19 13:34:03.978358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1045/2021] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:04.066102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:04.066987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:04.077476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:04.078256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:04.078987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:04.080129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:04.080936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:04.081617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:04.224996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:04.234959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a91ab423-79d2-436b-ab71-109d97caee8d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175568 Oct 19 13:34:04.235549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 977/2022] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:04.985794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:04.986501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:04.994827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:04.995464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:04.995975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:04.997148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:04.997743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:04.998832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:05.005078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:05.005821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:05.013586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:05.014068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:05.014514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:05.015215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:05.015658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:05.016070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:05.082253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:05.091526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:05.092996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:05.094135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0766f086-52a6-4bd3-a754-b8c681e18fb6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094093 Oct 19 13:34:05.094691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 978/2023] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:05.135386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:05.144101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b24178bb-c362-401b-9ad9-e7c8fb485618 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163376 Oct 19 13:34:05.144663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1046/2024] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:05.262657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:05.263187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:05.269679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:05.270153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:05.270575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:05.271252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:05.271694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:05.272100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:05.420373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:05.433351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7dce69cb-4198-4537-9cab-cb71f740efc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176257 Oct 19 13:34:05.433945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 979/2025] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:06.122080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:06.122729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:06.130460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.130965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.131414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.132137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.132608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.133088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.168084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:06.169181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:06.175911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.176324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.176765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.177492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.180049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.180049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.199688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:06.209014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:06.210440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:06.211585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-23c1aff1-775e-4e51-a980-35b62bdc6ed0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095533 Oct 19 13:34:06.212153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1047/2026] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:06.317484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:06.326239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c4e8cc6b-9c6e-43a1-981e-5b591e7d8a74 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162471 Oct 19 13:34:06.326799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 980/2027] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:06.460588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:06.461381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:06.471764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.472538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.473294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.474385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:06.475091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:06.475734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:06.609962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:06.622931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-08509d8c-b9ef-438c-be8d-533c168b0c33 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168500 Oct 19 13:34:06.624052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1048/2028] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:06 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:07.242060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:07.243091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:07.254864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.255666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.256382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.257579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.258324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.259022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.328162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:07.341497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:07.343565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:07.345306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9e22018a-7787-458b-a241-9ba8a653ea77 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.109575 Oct 19 13:34:07.346026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 981/2029] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:07.354603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:07.355389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:07.362427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.362914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.363344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.364036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.364486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.364906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.497325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:07.506334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4961085a-68f4-468d-82cf-ef87aec18511 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160012 Oct 19 13:34:07.506911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1049/2030] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:07.651196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:07.652160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:07.658359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.658847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.659275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.659956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:07.660425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:07.660838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:07.795003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:07.808064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f89b476a-fba4-41f1-a1fc-4f216e2c8d45 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161053 Oct 19 13:34:07.808781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 982/2031] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:07 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:08.375032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:08.375604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:08.382847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.383322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.383753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.384440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.384900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.385337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.448887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:08.458015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:08.459448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:08.460594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1425fcf5-2464-471b-a942-26768f2956e6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090622 Oct 19 13:34:08.461185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1050/2032] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:08.530919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:08.531489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:08.538456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.538941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.539371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.540058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.540506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.540955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.674744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:08.683619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-744c0fca-5570-4984-8475-7692bea74924 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156586 Oct 19 13:34:08.684273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 983/2033] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:08.835528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:08.836428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:08.846501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.847243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.847940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.849100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:08.849825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:08.850492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:08.989713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:09.002579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c8aca248-2b46-42cb-b759-5986f846f443 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173307 Oct 19 13:34:09.003413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1051/2034] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:09.490678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:09.491680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:09.502823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:09.503617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:09.504333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:09.505690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:09.506442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:09.507131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:09.576017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:09.590391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:09.592791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:09.594714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86c25608-e927-4a1e-ba50-5ce44c1e9bad tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110523 Oct 19 13:34:09.595611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 984/2035] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:09.711036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:09.711999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:09.722355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:09.723146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:09.723858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:09.725021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:09.725786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:09.726472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:09.882728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:09.891725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bcb12d3b-5714-45ed-bbc1-b95040c25e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.187164 Oct 19 13:34:09.892292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1052/2036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:10.031483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:10.032178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:10.039446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.039969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.040441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:10.041233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.041715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.042176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:10.183636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:10.196151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-26a14c2f-5f9f-421e-8187-7e8645a0bcb9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169080 Oct 19 13:34:10.196881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 985/2037] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:10.628284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:10.629271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:10.639336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.640075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.640746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:10.641879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.642578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.643224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:10.710950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:10.724195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:10.726055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:10.727786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-01a6eda9-2a46-40f0-9bb1-0ab8ddaf0ee6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105609 Oct 19 13:34:10.728523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1053/2038] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:10.918393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:10.918964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:10.926061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.926532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.926954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:10.927636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:10.928078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:10.928495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:11.066544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:11.075335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-db125629-815b-48bc-ad55-7a872f51d792 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163488 Oct 19 13:34:11.075909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 986/2039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:11.219927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:11.220442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:11.226956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:11.227445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:11.227875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:11.228575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:11.229065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:11.229498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:11.232208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:11.378647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:11.391364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1b02b61e-529b-4a07-847f-5752ba3badc7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175177 Oct 19 13:34:11.392222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1054/2040] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:11.763553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:11.764156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:11.771356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:11.771858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:11.772309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:11.773071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:11.773521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:11.773953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:11.847427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:11.857413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:11.858859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:11.860008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e3ae398f-5cc3-484a-a3c4-35439838661b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103034 Oct 19 13:34:11.860562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 987/2041] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:12.102923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:12.103834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:12.114869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.115670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.116391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.117575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.118330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.119036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.258312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:12.271142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d8398717-1c2a-4644-95a8-e28a74f148e7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174605 Oct 19 13:34:12.271800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1055/2042] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:12.420546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:12.421172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:12.428002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.428482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.428943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.429640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.430092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.430544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.586728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:12.595323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-badd501a-cd14-422f-9041-13b9590b5f70 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.178988 Oct 19 13:34:12.595887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 988/2043] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:12.889756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:12.890670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:12.900241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.901018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.901686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.902684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:12.903140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:12.903545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:12.976013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:12.985169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:12.986527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:12.987662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-693d18f8-305a-405f-9085-08d8a90c218e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104380 Oct 19 13:34:12.988216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1056/2044] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:13.298420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:13.299170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:13.307958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:13.308583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:13.309106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:13.309879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:13.310225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:13.310635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:13.457616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:13.470643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b808f057-e7d0-4ce6-bc9c-c3b4bb849763 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.177771 Oct 19 13:34:13.471399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 989/2045] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:13.623409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:13.624018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:13.631419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:13.631927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:13.632404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:13.633174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:13.633646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:13.634091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:13.776385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:13.785180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c91d9ac-0471-4602-ba57-59a663859c4e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168306 Oct 19 13:34:13.785752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1057/2046] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:13 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:14.014893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:14.015532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:14.022182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.022693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.023140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.023843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.024368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.024805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.101832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:14.113134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:14.114574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:14.115716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb10ef71-68d6-4f62-bab3-ec36133d5938 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.105614 Oct 19 13:34:14.116270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 990/2047] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:14.500300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:14.500894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:14.502906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=76 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:14.508478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.508997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.509429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.510131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.510576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.511013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.656364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:14.669833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-665d5cf5-f3a6-4fe7-a950-ef311e3d24fb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173896 Oct 19 13:34:14.670508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1058/2048] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:14.811347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:14.811976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:14.820628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.821134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.821641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.822634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:14.823190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:14.823748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:14.827729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:14.968692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:14.977574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-72303890-79c8-40e2-b2bc-ee98cc00b3ee tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172650 Oct 19 13:34:14.978125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 991/2049] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:14 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:15.146084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:15.147087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:15.156405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:15.156907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:15.157357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:15.158066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:15.158516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:15.158934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:15.223190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:15.232522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:15.233993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:15.235154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-84d81df6-4ff3-4534-8536-04cae126f2d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095804 Oct 19 13:34:15.235716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1059/2050] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:15.707571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:15.708164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:15.714615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:15.715094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:15.715515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:15.716753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:15.716990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:15.717439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:15.851941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:15.861469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d6503710-1aa8-4f9a-bf93-02b99b3815a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157730 Oct 19 13:34:15.862292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 992/2051] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:16.005878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:16.006468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:16.013319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.013985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.014424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:16.015122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.015568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.016013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:16.154242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:16.163181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4009724c-4ef0-42e4-833a-e4dc70231488 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161273 Oct 19 13:34:16.163756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1060/2052] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:16.262244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:16.262830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:16.269997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.270579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.271078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:16.271858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.272423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.272714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:16.345307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:16.354168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:16.355816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:16.357392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b4be8d5b-66d5-4f4e-8359-40c4ab50d6d6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100165 Oct 19 13:34:16.358238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 993/2053] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:16.890623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:16.891096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:16.897573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.898063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.898510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:16.899207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:16.899693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:16.900101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:17.040440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:17.049717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7bec7dec-8876-49ff-830b-33fddcdd678c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164125 Oct 19 13:34:17.050300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1061/2054] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:17.188526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:17.189155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:17.190994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=80 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:17.196989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:17.197519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:17.197951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:17.198631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:17.199101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:17.199511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:17.342444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:17.356997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c7af2edd-20b0-4084-b58f-c0e7f6ab9cce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172934 Oct 19 13:34:17.357651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 994/2055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:17.385546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:17.386155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:17.394385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:17.394876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:17.395302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:17.396000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:17.396453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:17.396937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:17.459603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:17.468826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:17.470277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:17.471431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-862ef531-2baf-4773-ba54-119a216f7c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089926 Oct 19 13:34:17.471987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1062/2056] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:18.076918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:18.077887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:18.088010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.088792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.089554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.090683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.091442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.091856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.233856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:18.248410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7bc4f72d-9d2f-4618-bbfe-16c4eb54e0c1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.177560 Oct 19 13:34:18.249032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 995/2057] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:18.380680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:18.381304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:18.389020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.389516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.389958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.390660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.391117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.391537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.503289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:18.503894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:18.510202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.510677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.511091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.511792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:18.512232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:18.512642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:18.544001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:18.553761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0269e0ca-a96c-4ca5-8ff9-d024364d6541 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.177026 Oct 19 13:34:18.554400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1063/2058] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:18.578954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:18.587778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:18.589225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:18.590344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-70706059-7cc3-4ce2-862a-72bae55a3112 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091174 Oct 19 13:34:18.591526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 996/2059] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:34:19.272160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:19.272770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:19.279270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.279751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.280184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.280886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.281490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.281909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.418654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:19.427461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3cd2f7d3-1c6a-4265-822e-1e2d9cc03ed8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159276 Oct 19 13:34:19.428006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1064/2060] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:19.579133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:19.579712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:19.586822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.587300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.587730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.588419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.588890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.589309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.615692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:19.616338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:19.623943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.624434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.624894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.625643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:19.626099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:19.626527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:19.699597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:19.709219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:19.710687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:19.711843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-be1f7ae9-27fa-45de-9258-6704b1f1e51b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100121 Oct 19 13:34:19.712400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1065/2061] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:19.742832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:19.751587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dfd18f4f-09b5-4caf-94d8-c5d1094db09e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176608 Oct 19 13:34:19.752162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 997/2062] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:19 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:20.451403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:20.452054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:20.461927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.462591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.463159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.463874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.464321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.464737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.602523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:20.612420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8019ff0c-033d-4230-b82a-9f4118e5913f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164934 Oct 19 13:34:20.613003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1066/2063] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:20.742303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:20.742875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:20.753725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.754541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.755300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.756527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.757358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.758112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.775396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:20.776008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:20.783479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.783943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.784398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.785122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:20.785587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:20.786013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:20.834050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:20.843400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:20.844892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:20.846061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-160cface-b8a8-46bf-8307-4ea660037fa3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.110372 Oct 19 13:34:20.846646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 998/2064] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:20.931677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:20.941635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f99af436-e1f8-4b16-b813-7596db1367e9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170071 Oct 19 13:34:20.942500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1067/2065] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:20 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:21.638785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:21.639288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:21.647429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.647903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.648322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:21.649045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.649483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.649889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:21.794428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:21.803142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-22e016a1-f3e6-4e84-85dd-7e0f505c3ccb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.170317 Oct 19 13:34:21.803713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 999/2066] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:21.875382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:21.876023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:21.883008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.883492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.883947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:21.884614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.885119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.885539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:21.957696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:21.965484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:21.966210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:21.967851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:21.969325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:21.970505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f9a5b429-180d-4fd8-b98c-06bec435f072 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100025 Oct 19 13:34:21.971264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1068/2067] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:21.973091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.973882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.974054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:21.974750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:21.975241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:21.975679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:22.119006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:22.128625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-09e8fa7a-02c9-4770-9ff0-0a9d6483f308 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166691 Oct 19 13:34:22.129432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1000/2068] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:34:22.826689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:22.827295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:22.834100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:22.834585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:22.835017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:22.835713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:22.836157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:22.836621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:22.976805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:22.987753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ebedb02-ab92-4b78-879a-8f76ad1ff843 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164933 Oct 19 13:34:22.988248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1069/2069] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:22.995763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:22.996465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:23.004142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:23.004615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:23.005087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:23.005783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:23.006221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:23.006633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:23.076106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:23.087821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:23.089820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:23.091001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bffc7ed5-61e5-4ffc-9407-b87834cedeaf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099234 Oct 19 13:34:23.091528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1001/2070] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:23.156424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:23.157147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:23.164673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:23.165210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:23.165625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:23.166331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:23.166791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:23.167206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:23.310852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:23.315231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:23.321970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d590f98d-d525-4444-9948-c6ab2d80be79 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170328 Oct 19 13:34:23.322553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1070/2071] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:24.011964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:24.012611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:24.020140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.020552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.021018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.021717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.022169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.022587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.118709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:24.119448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:24.127042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.127615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.128122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.128914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.129449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.129874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.164778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:24.173948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7168ccda-09f4-4315-8c35-8cf68d52ed49 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165892 Oct 19 13:34:24.174531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1002/2072] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:24.197044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:24.206317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:24.207767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:24.208958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e1acaeae-9f47-43ac-9d54-397da1735047 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094279 Oct 19 13:34:24.209534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1071/2073] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:24.346153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:24.346762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:24.353304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.353782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.354207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.354889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:24.355324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:24.355729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:24.495725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:24.505399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e2947247-185b-4fc1-8ca9-6d825ba4c2f8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163047 Oct 19 13:34:24.505985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1003/2074] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:25.198068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:25.198767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:25.207557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.208382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.209239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.210486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.211203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.211949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.236003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:25.236754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:25.243606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.244087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.244515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.245251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.245697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.246112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.319674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:25.331162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:25.337882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:25.337882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1ad2c161-0c66-4a1b-bd52-aa7011623f62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104704 Oct 19 13:34:25.337882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1004/2075] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:34:25.369575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:25.379430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6991b9a2-167d-4f15-b917-d0f1ac30c15d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.185170 Oct 19 13:34:25.380317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1072/2076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:25.532065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:25.532676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:25.539205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.539682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.540108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.540808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:25.541291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:25.541684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:25.691025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:25.699770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d860ec12-73f7-4bb3-a8df-fe4fa76ae27d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173972 Oct 19 13:34:25.700326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1005/2077] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:25 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:26.367932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:26.368575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:26.376624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.377162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.377598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.378310 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.378742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.379189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.404728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:26.405520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:26.412169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.412727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.413179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.413869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.414304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.414708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.537421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:26.548174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:26.549801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:26.550978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1906f51-ef59-45bd-81c1-ed281dd1eb3a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.187162 Oct 19 13:34:26.551599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1073/2078] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:26.580624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:26.589042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-486c4c87-50db-4ebd-bb37-fb2e5603945b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.188757 Oct 19 13:34:26.589610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1006/2079] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:26.724467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:26.725132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:26.731993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.732925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.733297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.734006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:26.734468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:26.734884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:26.875743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:26.884587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-684e2b80-d369-45fd-9a6b-96d36196aa39 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164326 Oct 19 13:34:26.885427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1074/2080] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:26 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:27.587095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:27.587676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:27.594626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.595101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.595529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:27.596232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.596673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.597123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:27.613809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:27.614423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:27.621499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.621845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.622312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:27.623377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.623794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.624249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:27.664790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:27.667122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:27.675467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:27.676916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:27.678158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb6fb750-40e3-44c1-89fa-78133d32bf88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095183 Oct 19 13:34:27.679090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1007/2081] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:27.768996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:27.777519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-be23765c-2465-4163-933f-fa1e98d98e7b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167703 Oct 19 13:34:27.778093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1075/2082] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:27.909720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:27.910329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:27.916766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.917303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.917707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:27.918400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:27.918840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:27.919255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:28.069353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:28.078552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-245d2bff-e6d1-448c-b2e8-dace975e5628 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172976 Oct 19 13:34:28.079135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1008/2083] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:28.787032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:28.787674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:28.794334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:28.794840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:28.795274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:28.796063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:28.796517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:28.796965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:28.802270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:28.802886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:28.809609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:28.810085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:28.810608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:28.811342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:28.811792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:28.812212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:28.864931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:28.874316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:28.875773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:28.876974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae6c85cb-5164-4a82-9f33-9544f2fcf65e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.176874 Oct 19 13:34:28.877545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1076/2084] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:28.945524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:28.954620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-90307d59-1fc0-4271-8df6-b3928b4349b7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156340 Oct 19 13:34:28.955204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1009/2085] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:29.112313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:29.112956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:29.119421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.119914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.120342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.121071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.121523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.121954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.266528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:29.278167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9cdff935-d9ad-427a-85e8-6c0d14ac16fd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169548 Oct 19 13:34:29.278406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1077/2086] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:29 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:29.903139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:29.903733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:29.912772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.912772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.912772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.913529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.913965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.914389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.978401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:29.979298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:29.985587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:29.986040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.986521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.986974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.987677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:29.988131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:29.988552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:29.994806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:29.996256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:29.998108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4343525a-e532-48a9-9042-090ebec7bbee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098619 Oct 19 13:34:29.998885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1010/2087] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:30.123952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:30.132823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d150c896-9979-4b08-8083-f0df2629ef23 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158354 Oct 19 13:34:30.133470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1078/2088] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:30.301862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:30.302617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:30.309496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:30.309982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:30.310517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:30.311588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:30.312026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:30.312456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:30.453429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:30.462099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-301970a6-bc0b-47f2-96b0-301b0fb6eabf tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164286 Oct 19 13:34:30.462686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1011/2089] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:30 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:31.027091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:31.027797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:31.035819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.036307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.036849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.037459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.038230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.038605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.104128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:31.114927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:31.116348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:31.117541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2594d6b9-188d-46f2-8bf5-1ba32d4ba9d8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096291 Oct 19 13:34:31.118099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1079/2090] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:31.157731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:31.158717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:31.165526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.166003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.166427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.167141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.167576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.167992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.319568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:31.329320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ed94723a-6cec-4f26-985e-56192eee7ee7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.177185 Oct 19 13:34:31.329885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1012/2091] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:34:31.499880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:31.500502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:31.506991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.507473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.507910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.508602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:31.509083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:31.509504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:31.652311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:31.662498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-21dec6b3-649e-4615-883c-eb6f186d791b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167134 Oct 19 13:34:31.663076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1080/2092] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:31 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:32.149049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:32.150029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:32.159578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.160749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.161065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.162207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.162931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.163611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.234971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:32.243892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:32.245339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:32.246476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07fa8cce-5636-467d-b18a-cf1595a84c62 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104043 Oct 19 13:34:32.247025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1013/2093] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:32.355825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:32.356788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:32.367490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.368262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.369030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.370175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.370919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.371612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.520070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:32.529270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0d4465f1-d80a-4fae-84cd-9939694870cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.177580 Oct 19 13:34:32.529913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1081/2094] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:32.698291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:32.699094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:32.706228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.706707 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.707130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.707852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:32.708284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:32.708692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:32.844000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:32.852446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-08b2d880-eaeb-4359-949a-905c5c0fce64 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.160510 Oct 19 13:34:32.853120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1014/2095] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:32 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:33.271803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:33.272398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:33.278964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.279493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.279956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:33.280662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.281218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.281637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:33.349992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:33.359434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:33.360897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:33.362068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-451ccfb5-036b-465e-a07b-22a6095f7daa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094844 Oct 19 13:34:33.362627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1082/2096] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:33.551967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:33.552551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:33.559555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.560032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.560706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:33.561617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.562059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.562470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:33.695494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:33.704731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ba2bb39f-5eb8-481d-8a1c-8f2214f07e00 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156723 Oct 19 13:34:33.705452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1015/2097] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:33.876668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:33.877235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:33.884437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.884937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.885388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:33.886056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:33.886512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:33.886929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:34.041243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:34.049824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-14d5cf48-81cb-47a6-be38-3a5317916d51 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.177771 Oct 19 13:34:34.050395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1083/2098] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:33 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:34.387491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:34.388087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:34.394798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:34.395264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:34.395687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:34.396377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:34.396813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:34.397258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:34.463428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:34.473062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:34.474542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:34.475696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49d92a0a-975b-49d1-a8bc-cf55e9f74025 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092223 Oct 19 13:34:34.476259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1016/2099] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:34.728556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:34.729184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:34.736367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:34.736886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:34.737338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:34.738039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:34.738498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:34.738927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:34.879117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:34.889197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ffe48cd5-ffbc-4f0c-9b01-5c6f742b51b5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164121 Oct 19 13:34:34.889421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1084/2100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:35.077015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:35.077641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:35.084511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.085018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.085447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:35.086134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.086577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.086992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:35.227285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:35.236395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-be070c73-df19-44bc-b1bc-cca9872e9882 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165532 Oct 19 13:34:35.237051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1017/2101] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:35 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:35.502250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:35.502771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:35.509389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.509873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.510336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:35.511032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.511459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.511877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:35.580708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:35.589801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:35.591351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:35.593296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-31ab2a75-3363-436b-940b-3953255345ab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096366 Oct 19 13:34:35.593897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1085/2102] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:35.921702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:35.922317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:35.928768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.929278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.929706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:35.930405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:35.930850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:35.931262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:36.065683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:36.074475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-08588caa-b26c-4c08-821f-9b4836bd046c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158329 Oct 19 13:34:36.075058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1018/2103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:36.259890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:36.260486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:36.267578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:36.268070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:36.268511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:36.269240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:36.269869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:36.270302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:36.412339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:36.421342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9f9642c1-2690-4aa9-8049-1bb86ea2d2e2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165419 Oct 19 13:34:36.421921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1086/2104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:36 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:36.624094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:36.624708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:36.632000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:36.632482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:36.632892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:36.633625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:36.634072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:36.634486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:36.705594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:36.718470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:36.719901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:36.721084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb6327ba-d459-433a-b165-51c576de23f2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101464 Oct 19 13:34:36.721876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1019/2105] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:37.099198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:37.099836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:37.106338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.106826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.107359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.108327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.108789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.109250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.125202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:37.253890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:37.262350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-33260713-f2a3-4c9f-bd9e-f825e015e628 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167061 Oct 19 13:34:37.263015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1087/2106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:37.444725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:37.445262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:37.451997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.452361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.452765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.453496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.453935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.454343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.607302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:37.616322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eaa774ee-3653-423d-936d-d38ea64fbfbe tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.175593 Oct 19 13:34:37.616938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1020/2107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:37 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:37.746668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:37.747168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:37.754980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.755457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.755882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.756561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:37.757054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:37.757471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:37.828389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:37.837658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:37.839098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:37.840289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd5eb3f8-2234-4250-8b60-d99f00f23d5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097791 Oct 19 13:34:37.841208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1088/2108] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:38.286452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:38.287054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:38.294076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.294534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.294962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.295664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.296106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.296515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.442663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:38.452380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57ccf97d-60c5-4a80-b4b2-ea24a60a7ace tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169801 Oct 19 13:34:38.453011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1021/2109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:38.640847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:38.641506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:38.647890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.648429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.648891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.649601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.650050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.650469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.790587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:38.801138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-010f85a8-bc9d-414c-833b-6a3fb60357ea tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.164375 Oct 19 13:34:38.801721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1089/2110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:38 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:38.869094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:38.869775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:38.878021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.878498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.878924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.879638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:38.880077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:38.880488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:38.949918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:38.963535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:38.965844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:38.967597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f232cad0-8684-4273-87e5-16dd9dd59d20 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.104618 Oct 19 13:34:38.968301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1022/2111] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:39.478409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:39.479412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:39.487237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:39.487718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:39.488155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:39.488853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:39.489342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:39.489767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:39.631662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:39.643705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-209e25ba-5f81-46ac-a2ed-5215f42b384e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.170567 Oct 19 13:34:39.644380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1090/2112] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:39.827110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:39.828100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:39.838523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:39.839145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:39.839847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:39.840996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:39.841759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:39.842442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:39.992150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:39.992827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:40.001013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:40.001013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:40.001405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:40.002109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:40.002561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:40.002843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:40.002990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:40.011635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d6d447c-7eda-407c-bd14-eadcab9149d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.191033 Oct 19 13:34:40.012215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1023/2113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:39 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:40.071525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:40.081092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:40.082471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:40.083624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9198c7b3-3150-4e6b-8eff-8a9c9d63bded tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095806 Oct 19 13:34:40.084187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1091/2114] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:34:40.669241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:40.669892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:40.678004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:40.678482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:40.678909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:40.679625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:40.680083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:40.680494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:40.697251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:40.823760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:40.834787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e5beff5a-0ee6-4214-8f54-a1815e0eb986 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169795 Oct 19 13:34:40.835475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1024/2115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:41.035497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:41.036070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:41.043036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.043531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.043952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:41.044643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.045125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.045544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:41.110196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:41.110878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:41.117232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.117701 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.118144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:41.118815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.119306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.120460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:41.200241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:41.203825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:41.209723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f06fbdd-38e2-4e9a-a33c-309ce05ab37f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.178075 Oct 19 13:34:41.210274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1092/2116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:41 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:41.215993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:41.217501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:41.218822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-acffd300-25f8-4001-8704-57da2ffad163 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.114209 Oct 19 13:34:41.219368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1025/2117] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:34:41.859089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:41.859936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:41.868445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.868992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.869520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:41.870423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:41.871051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:41.871608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:42.019936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:42.028810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51f525c5-0901-416f-bbb8-a22822b04a62 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.173644 Oct 19 13:34:42.029553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1093/2118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:42.233589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:42.234164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:42.241366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:42.241848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:42.242291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:42.242990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:42.243477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:42.243891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:42.245278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:42.246072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:42.253528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:42.254009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:42.254458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:42.255167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:42.255815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:42.256228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:42.336152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:42.346243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:42.347719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:42.348851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f56cce5d-5978-4434-a6bc-0fce64d6e4d2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.108432 Oct 19 13:34:42.349470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1094/2119] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:42.392907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:42.402016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-05415e39-3101-4b4b-a376-502eb7cab290 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.172291 Oct 19 13:34:42.402598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1026/2120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:42 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:43.060457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:43.061096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:43.068809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.069536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.070179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.071264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.071912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.072365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.222601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:43.231137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c258a0ce-7f7f-4b70-bf4d-8bcd6132031d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.175791 Oct 19 13:34:43.231692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1095/2121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:43.376408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:43.377139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:43.384423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.384923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.385382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.386199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.386516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.386933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.431202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:43.431944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:43.441839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.442357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.442789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.443492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:43.443948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:43.444363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:43.452914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:43.463138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:43.465354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:43.466829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8025a69a-0203-43a0-8e0c-e68f909c11de tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095037 Oct 19 13:34:43.467393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1027/2122] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:43.593442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:43.604629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-704872ac-c21a-4269-86ca-52cf223b1fb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.176106 Oct 19 13:34:43.604629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1096/2123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:43 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:44.254808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:44.255412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:44.262670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.263207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.263746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.264629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.265098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.265512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.420120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:44.429021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e90ed0ff-a0f9-4a0b-86c3-1c24f03022d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.178108 Oct 19 13:34:44.429589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1028/2124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:44.494432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:44.495069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:44.502157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.503392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.503699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.504418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.504937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.505467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.579314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:44.590007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:44.591430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:44.592604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-85b11e29-ad04-4bc1-9a66-934baebe109e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102771 Oct 19 13:34:44.593213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1097/2125] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:34:44.630551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:44.631168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:44.637487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.638259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.638704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.639375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:44.639811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:44.640213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:44.783260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:44.792187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-572b8893-87d6-4b21-809a-ab7940707fb1 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.165742 Oct 19 13:34:44.792793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1029/2126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:44 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:45.456723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:45.457369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:45.459287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=80 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:45.464802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.465313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.465749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.466436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.466901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.467323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.601107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:45.609717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-241f898a-7c65-4c26-8253-69abbd60f020 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159138 Oct 19 13:34:45.610284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1098/2127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:45.618798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:45.619537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:45.626737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.627844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.628266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.629022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.629489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.629907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.693201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:45.702298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:45.703724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:45.704855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d9f8771f-c5b1-4e99-a516-5d359ec744dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090037 Oct 19 13:34:45.705477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1030/2128] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:45.816307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:45.816971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:45.823526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.824012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.824461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.825204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:45.825657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:45.826147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:45.969464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:45.978866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60d41c71-f046-44df-a724-f8e5df8a350e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166879 Oct 19 13:34:45.979444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1099/2129] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:45 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:46.634537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:46.635148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:46.641640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:46.642119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:46.642562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:46.643254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:46.643695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:46.644109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:46.732400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:46.733640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:46.742376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:46.742876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:46.743300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:46.744009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:46.744489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:46.744949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:46.787163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:46.795633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-12a7f84d-335a-4928-9ec6-4e943d2bfce2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165195 Oct 19 13:34:46.796216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1031/2130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:46.814224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:46.823515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:46.824900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:46.826075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5d1ed29e-a530-427d-aa00-413d5b192af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099283 Oct 19 13:34:46.826642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1100/2131] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:47.003915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.004559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:47.011043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.011503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.011964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.012667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.013157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.013590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.145441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:47.154177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-53df7de3-b203-406f-8fc6-999aa569e11f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.154226 Oct 19 13:34:47.154741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1032/2132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:46 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:47.823343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.824500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:47.834137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.834621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.835056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.835755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.836211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.836636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.851601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:47.852454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:47.854822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=78 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:47.860288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.860762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.861198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.861883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:47.862350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:47.862759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:47.930162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:47.939070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:47.940849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:47.942024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8425154-b829-4059-93c8-10e63d90ba9c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094380 Oct 19 13:34:47.942584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1033/2133] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:47.977856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:47.986514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3d35ade2-50dd-42c2-8705-4bcd72fa0542 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169758 Oct 19 13:34:47.987078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1101/2134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:48.183016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:48.183893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:48.192713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:48.193300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:48.193732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:48.194419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:48.194869 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:48.195288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:48.333748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:48.342252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7d3191aa-1715-484b-be5e-c2634cfc8141 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.166401 Oct 19 13:34:48.342826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1034/2135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:48 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:48.971152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:48.971841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:48.983042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:48.983858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:48.984636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:48.985818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:48.986772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:48.987338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:49.010867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:49.011557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:49.018978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:49.019543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:49.019950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:49.020643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:49.021113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:49.021532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:49.051427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:49.060556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:49.062022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:49.063170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-57b8d4a5-b259-4058-9e00-87d62083d80f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098636 Oct 19 13:34:49.063972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1102/2136] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:49.157865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:49.166670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0268cd0b-026c-4ac9-9b1c-3be645e68a48 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159909 Oct 19 13:34:49.167240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1035/2137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:34:49.370114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:49.371134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:49.380230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:49.380720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:49.381195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:49.381893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:49.382347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:49.382804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:49.523153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:49.531760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4020c1b7-da2d-40f9-a52b-1923e9470712 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.168200 Oct 19 13:34:49.532334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1103/2138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:49 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:50.092058 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:50.092713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:50.100168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.100650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.101098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.101861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.102309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.102722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.165664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:50.174916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:50.176354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:50.177555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2089f116-b596-486d-ac07-63dcec2001e9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089628 Oct 19 13:34:50.178099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1036/2139] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:50.190983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:50.191599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:50.197926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.198416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.198836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.199524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.199981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.200398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.202955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:50.333435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:50.343977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-13befb74-d637-46f4-9e72-7ba3e18a4af4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156788 Oct 19 13:34:50.344769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1104/2140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:50.555571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:50.556179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:50.562711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.563196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.563628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.564343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:50.564800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:50.565253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:50.711666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:50.721655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fbed89e8-0045-41ca-9b95-41d2d1b8f860 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.169511 Oct 19 13:34:50.722532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1037/2141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:50 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:51.203955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:51.204654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:51.211196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.211683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.212118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.212811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.213295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.213718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.280789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:51.290381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:51.291900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:51.293071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d23d6635-c3e4-44f3-ad45-4f7bc3d544ef tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093610 Oct 19 13:34:51.293634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1105/2142] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:51.368006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:51.368777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:51.379063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.379523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.379972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.380666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.381158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.381600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.522816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:51.531416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7289481c-37d3-4992-9403-70c3d28f552a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167248 Oct 19 13:34:51.531896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1038/2143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:51.745500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:51.746113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:51.753527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.754012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.754451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.755143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:51.755598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:51.756001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:51.899179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:51.909290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ade217e7-78a4-426d-8151-7e2cef92d2dd tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.167747 Oct 19 13:34:51.909899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1106/2144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:51 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:52.319328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:52.319970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:52.326548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.327018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.327448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:52.328125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.328561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.329003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:52.397773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:52.407050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:52.409201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:52.410344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-75719389-7ba5-4af3-ae66-8861e6023bee tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095062 Oct 19 13:34:52.410909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1039/2145] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:52.555902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:52.556519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:52.563509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.563989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.564526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:52.565280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.565790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.566147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:52.699902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:52.710188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-221496fb-eb83-4eac-a30d-3e679995e507 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158266 Oct 19 13:34:52.710788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1107/2146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:52.935872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:52.936457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:52.946607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.947321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.947961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:52.949076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:52.949687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:52.950256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:53.083222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:53.091976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2535e66b-d243-4a0d-9ab4-02b6473682a2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162679 Oct 19 13:34:53.092586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1040/2147] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:52 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:53.439698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:53.440419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:53.446930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:53.447409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:53.447856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:53.448533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:53.449017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:53.449465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:53.515318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:53.524256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:53.525714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:53.526850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6e82981d-7504-43a2-a68c-3312302fde38 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093504 Oct 19 13:34:53.527415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1108/2148] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:53.735123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:53.735724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:53.743108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:53.743585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:53.744037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:53.744712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:53.745201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:53.745629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:53.748549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:34:53.885296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:53.894781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1b04e46e-e9ea-424b-b749-04dfa9bec2cf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163668 Oct 19 13:34:53.895357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1041/2149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:54.116077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:54.116711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:54.124035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.124522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.124985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:54.125675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.126126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.126544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:54.273009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:54.285894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-df42eb27-8a5e-4580-95fb-a6a19795a19a tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.173798 Oct 19 13:34:54.286456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1109/2150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:54 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:54.553551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:54.554158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:54.560346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.560830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.561312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:54.561990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.562433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.562843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:54.638900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:54.648326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:54.649766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:54.650896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-06be3661-a84f-4796-972e-3a7a04928440 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101823 Oct 19 13:34:54.651419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1042/2151] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:54.918798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:54.919526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:54.925849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.926339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.926779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:54.927478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:54.927917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:54.928360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.065437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:55.074071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-952b4a68-017a-4a3c-98cd-23e3ce803f01 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158976 Oct 19 13:34:55.074463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1110/2152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:55.312180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:55.312783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:55.319778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.320253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.320680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.321384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.321822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.322227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.458374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:55.470470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f6451e7f-c904-4b2e-8c26-4c26a53f4eb0 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.161948 Oct 19 13:34:55.471340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1043/2153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:55 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:55.676553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:55.677187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:55.684127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.684612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.685090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.685784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:55.686242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:55.686667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:55.756823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:55.766109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:55.767703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:55.768890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a2dec679-0b44-4264-83ec-ba38e344650e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096693 Oct 19 13:34:55.769486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1111/2154] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:56.097709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.098311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:56.104724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.105233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.105655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.106332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.106773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.107184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.237502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.246249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dbbc5d37-7ca9-44ce-8394-c2e7ed612f7c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152531 Oct 19 13:34:56.247156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1044/2155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:56.494370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.494885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:56.501772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.502227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.502882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.503573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.504024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.504443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.636843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.645921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60358965-cc24-41d8-a1fc-6e851b10073f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.155529 Oct 19 13:34:56.646506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1112/2156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:56.794432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:56.795044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:56.802109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.802600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.803017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.803779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:56.804268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:56.804734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:56.871000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.881773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.883402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:56.884587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9da9634b-3972-43cd-baab-248616ca6c03 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094387 Oct 19 13:34:56.885237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1045/2157] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:57.271078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.271702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:57.278816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.279297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.279754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.280440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.280888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.281338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.415192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.424176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-506e2de9-898c-44fc-8ca6-b57986bc86f9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157090 Oct 19 13:34:57.424951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1113/2158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:57.670306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.671059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:57.677361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.677846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.678271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.679291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.680021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.680793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.815074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.823642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e8503153-e00f-4709-9366-2fd013f5321b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157491 Oct 19 13:34:57.824267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1046/2159] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:57.911277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:57.911883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:57.918109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.918646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.919121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.919844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:57.920302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:57.920830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:57.987141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.996136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.997930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:57.999067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-73b650de-19b6-46b5-a6d0-da11a805b8f0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092721 Oct 19 13:34:57.999616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1114/2160] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:58.447997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.448610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:58.455185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.455902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.456688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.457455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.457911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.458334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.590561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:58.599174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49b1c2a5-0fb8-49f8-9543-9c8ef3522e34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155069 Oct 19 13:34:58.599706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1047/2161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:58.847455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:58.848022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:58.854936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.855419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.855848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.856544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:58.857019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:58.857440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:58.993159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.002904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cb30a83f-49a7-47c1-a664-9763114383a8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159052 Oct 19 13:34:59.003497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1115/2162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:58 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:34:59.024045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:59.024619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:59.031343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.031823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.032258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.032974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.033659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.034134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.101384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.110209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.111939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.113177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a395f508-ebc2-434f-bf72-4a0928ad79f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093083 Oct 19 13:34:59.113736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1048/2163] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:34:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:34:59.623575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:34:59.624214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:34:59.630687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.631180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.631619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.632323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:34:59.632775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:34:59.633232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:34:59.765823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:34:59.774558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7d90794d-a2eb-479b-8db0-86b450468644 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155344 Oct 19 13:34:59.775138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1116/2164] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:34:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:00.028516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.029163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:00.036696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.037208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.037634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.038326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.038766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.039180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.138848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.139439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:00.146385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.146870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.147298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.148007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.148456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.148891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.179072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.187578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0ec39068-b040-4aef-af03-a5e8a12cc260 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163073 Oct 19 13:35:00.188150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1049/2165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:00.215116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.224178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.225652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.226811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-defb0049-5e70-4fa8-82d3-28cfd1e60b97 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091942 Oct 19 13:35:00.227385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1117/2166] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:00.798401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:00.799209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:00.805728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.806206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.806632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.807316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:00.807759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:00.808169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:00.937944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:00.946485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ca5608b6-6cab-4881-96fd-e290684afc6c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152138 Oct 19 13:35:00.947046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1050/2167] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:01.212170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.212805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.219874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.220468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.220895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.221841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.222275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.222761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.252966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.253609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.260612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.261115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.261552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.262270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.262709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.263123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.338961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.348641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.350181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.351337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a5f2b41a-8a13-41ee-91a0-d5b69c46da4d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102705 Oct 19 13:35:01.351938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1051/2168] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:01.361225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:01.369868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b4c9218-f8ed-486c-bcfe-64234c88cc56 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.162626 Oct 19 13:35:01.370580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1118/2169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:01.970377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:01.971173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:01.977703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.978182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.978618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:01.979308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:01.979758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:01.980175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.118116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.127000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-98a784e5-4679-4690-8da9-0ed850d4cdc0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160496 Oct 19 13:35:02.128177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1052/2170] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:02.376384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.377161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:02.384123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.384614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.385097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.385803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.386256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.386685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.394747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:02.395370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:02.402239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.402733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.403168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.403927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:02.404375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:02.404798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:02.453512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.462625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.464070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.465264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-27282583-8064-4427-8bf0-55db246614b7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093247 Oct 19 13:35:02.466105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1119/2171] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:02.536800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:02.545556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-579931f3-91a4-4626-ae83-51c6da8c778c tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.155348 Oct 19 13:35:02.546147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1053/2172] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:02 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:03.151258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.151939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:03.158728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.159247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.159684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.160384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.160839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.161305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.296965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.299400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:03.307108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-620bc042-38c6-4056-ab98-4fafba9797a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159843 Oct 19 13:35:03.307687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1120/2173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:03.490911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.491517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:03.499000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.499475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.499897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.500579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.501045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.501454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.569583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.570225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:03.570834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:03.577478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.577956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.578385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.579003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.579181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:03.579496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:03.579909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:03.580843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.582117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c8a301c0-6bb4-4e80-84ca-8412294ce08a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095372 Oct 19 13:35:03.582673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1054/2174] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:03.709968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:03.718473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-245bbc05-7f23-4af7-9bbc-2823982a6ab2 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.152615 Oct 19 13:35:03.719040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1121/2175] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:03 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:04.331310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.331919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:04.338386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.338864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.339292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.339984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.340418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.340831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.473243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.481909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-be4494f8-2401-4e66-a1f0-f04b813d7666 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154913 Oct 19 13:35:04.482483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1055/2176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:04.608068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.608651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:04.617208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.617703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.618142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.618848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.619303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.619731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.683631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.692579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.694060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.695215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9797dcfc-ba9e-45a8-970d-1db059c0d725 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091227 Oct 19 13:35:04.695774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1122/2177] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:04.742278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:04.742832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:04.749988 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.750459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.750885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.751569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:04.752016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:04.752466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:04.892126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:04.895156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2fc00d11-d2f6-45bb-b160-231e87c5ca02 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.156743 Oct 19 13:35:04.895737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1056/2178] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:04 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:05.506311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.506922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.513676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.514166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.514600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.515291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.515740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.516157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.647988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.657313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1415d774-6a9a-43e6-9551-e63dda203eba tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154945 Oct 19 13:35:05.657865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1123/2179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:05.720093 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.721179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.727736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.728210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.728637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.729358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.729801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.730213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.797032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.799420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:05.807306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.808851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:05.810019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d9c41fd-7ac5-4f22-b852-b874ccf8b38a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093898 Oct 19 13:35:05.810586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1057/2180] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:05.918124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:05.918643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:05.925624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.926109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.926543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:05.927236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:05.927689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:05.928111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.059943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.068973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-07186032-6b4a-4b01-bbf2-26b456efdb8f tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.154886 Oct 19 13:35:06.069541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1124/2181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:05 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:06.680491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:06.681143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:06.687858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.688364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.688787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.689587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.690028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.690468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.836374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:06.837044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:06.845259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.845840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.846313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.847055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:06.847508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:06.847941 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:06.915691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.924756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.926229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:06.927377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9fb65943-dfd5-4cec-a5de-fc9e2c0f9ef1 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095271 Oct 19 13:35:06.928158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1125/2182] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:07.023170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.031564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-240ade62-98e2-4e6d-83db-f12e99901c71 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.355095 Oct 19 13:35:07.032160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1058/2183] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:07.092016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:07.092584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:07.099798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.100298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.100736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.101480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.101934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.102359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.242706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:07.251764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5e603a43-3a66-4411-8f84-f9ef6b3a7e5e tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163824 Oct 19 13:35:07.252579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1126/2184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:07 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:07.952808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:07.953449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:07.961000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.961482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.961913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:07.962598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:07.963048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:07.963462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.026693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.035785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.037274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.038405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e24d87ca-1f77-4233-9d04-2e3403015314 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089656 Oct 19 13:35:08.038965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1059/2185] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:08.055198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:08.055812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:08.062912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.063387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.063848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.064547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.065049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.065483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.197978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.206931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d4a8db8b-1259-46e4-9fd5-19bb597e84e8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155581 Oct 19 13:35:08.207649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1127/2186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:08.276113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:08.276731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:08.283569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.284144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.284556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.285286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:08.285742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:08.286162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:08.419095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:08.427406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-50e9f705-ac5b-48af-82a3-4076b99ec3ce tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.155273 Oct 19 13:35:08.427965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1060/2187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:08 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:09.063648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:09.064426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:09.071296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.071776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.072206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.072897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.073378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.073798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.137507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.146719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.148141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.149327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51e2c463-da26-4976-a729-ce105329e1c8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089657 Oct 19 13:35:09.149876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1128/2188] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:09.230952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:09.231555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:09.238487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.238970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.239400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.240086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.240531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.240976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.372385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.381246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-327ae749-3cdb-484f-8539-b0b0aa456694 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154243 Oct 19 13:35:09.381823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1061/2189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:09.450794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:09.451415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:09.458113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.458606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.459046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.459753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:09.460211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:09.460636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:09.595297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:09.604131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-55bd2673-450f-48e8-9183-36b73d32bc22 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157281 Oct 19 13:35:09.604744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1129/2190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:09 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:10.177906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.179032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.186645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.187123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.187560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.188242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.188687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.189138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.252449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.261495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.262990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.264122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2405000-4eab-4594-8d06-37d691965838 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093710 Oct 19 13:35:10.264658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1062/2191] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:10.404294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.404897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.412131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.412617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.413103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.413799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.414261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.414705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.549764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.558716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4aba0ecc-ef90-4423-825d-e4d9b778f2c3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158318 Oct 19 13:35:10.559293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1130/2192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:10.628632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:10.629284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:10.635693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.636173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.636604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.637327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:10.637773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:10.638189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:10.769733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:10.778179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-386f8a08-f81e-4814-802a-9d7b2de27a0b tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.153963 Oct 19 13:35:10.778731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1063/2193] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:10 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:11.288781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:11.289436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:11.296596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.297112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.297547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.298256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.298866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.299215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.367063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.376961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.378470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.379632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a677d1b0-1688-4035-addd-1b0297b9ac5b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094921 Oct 19 13:35:11.380199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1131/2194] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:11 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:11.582424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:11.583048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:11.589910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.590386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.590810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.591489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.591924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.592310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.723656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.732354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7f8a65db-edc8-4180-be16-5af2e23eca51 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153948 Oct 19 13:35:11.733108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1064/2195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:11.801847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:11.802406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:11.809424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.809927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.810361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.811049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:11.811493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:11.811912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:11.941566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:11.950160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b3d4c909-b979-47e2-b83a-1bc7b6cb63d3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.152267 Oct 19 13:35:11.950728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1132/2196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:11 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:12.405388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:12.405997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:12.412897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.413410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.413842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.414536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.414983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.415405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.477349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.486667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.488102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.489255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-45f16a30-6d05-4450-83fb-0da3e5478165 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.087836 Oct 19 13:35:12.489812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1065/2197] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:12.756167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:12.756776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:12.763332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.763807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.764243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.764967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.765398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.765806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.895241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:12.903910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7daf1b75-1321-4304-9a26-fcddcd2f8ab7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.151827 Oct 19 13:35:12.904456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1133/2198] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:12.973834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:12.974457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:12.981329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.981807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.982228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:12.982906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:12.983345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:12.983757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.120457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.129585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-32130fb0-c024-42da-b3fe-52938075c510 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159835 Oct 19 13:35:13.130177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1066/2199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:12 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:13.515021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:13.515640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:13.522300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.522797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.523236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.523942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.524399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.524823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.589425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.598601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.600043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:13.601228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-30e3d9c1-a510-4e9b-8c12-eac6e6bdfe68 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090323 Oct 19 13:35:13.601795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1134/2200] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:13.928041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:13.928546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:13.935063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.935533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.935957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:13.936633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:13.937110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:13.937522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.152840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:14.153602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:14.161496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.162065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.162572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.163307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.163759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.164179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.231948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.241194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-40d18195-5b50-45ee-8086-75bd9c967e96 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.317262 Oct 19 13:35:14.241806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1067/2201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:14.303731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.312229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2e3a4c4e-d921-4a1c-8168-bb83ae742ce9 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.163323 Oct 19 13:35:14.312807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1135/2202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:14 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:14.627645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:14.628236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:14.634530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.635000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.635399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.636916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:14.636916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:14.636916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:14.703533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.712752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.714197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:14.715299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-098dfaea-bdc5-4457-bf45-7d68172d3074 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091930 Oct 19 13:35:14.715866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1068/2203] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:15.266511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:15.267152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:15.275899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.276375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.276809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.277537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.277998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.278422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.336485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:15.337179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:15.344153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.344640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.345113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.345806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.346440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.346866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.412247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.421184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bbc152e5-7461-4959-8829-0e60d2c04ac4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158623 Oct 19 13:35:15.421767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1136/2204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:15.479073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.487429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-06e864a8-69c8-46c0-9157-5d2c9570f816 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.154823 Oct 19 13:35:15.487985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1069/2205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:15 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:15.740565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:15.741112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:15.743012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:15.749031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.749523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.749988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.750683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:15.751136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:15.751549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:15.768691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:15.819733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.828549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.830027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:15.831179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e1c752cb-059f-47dd-ab16-636f5dfb33e4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094814 Oct 19 13:35:15.831739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1137/2206] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:16.445473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:16.446067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:16.453015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.453494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.453923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.454598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.455195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.455615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.511050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:16.511680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:16.519241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.519735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.520158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.520879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.521374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.521799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.590001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.599184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-94c6c0eb-1e92-4020-aa5e-ca75a60380ad tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157575 Oct 19 13:35:16.599754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1070/2207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:16.658197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.666523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6cb0cb66-7a36-415a-93b8-bf7e6193f262 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159460 Oct 19 13:35:16.667433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1138/2208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:16 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:16.856296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:16.856815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:16.863376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.863878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.864304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.865098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:16.865541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:16.865964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:16.931906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.943714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.945218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:16.946372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-096ecad5-bace-45a6-967c-748eea3db205 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094368 Oct 19 13:35:16.946923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1071/2209] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:17.626890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.627824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.635820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.636286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.636743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.637656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.637930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.638769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.690987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.692369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.699786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.700270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.700684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.701415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.701856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.702263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.780407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.789274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-00d12bb3-5f03-44ea-8dd7-b67b3666524b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.169688 Oct 19 13:35:17.789848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1139/2210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:17.848326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:17.857132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-42d837f8-0a26-45c8-b551-c72a2eac631d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.170341 Oct 19 13:35:17.857698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1072/2211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:17.972383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:17.972899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:17.979412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.979899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.980337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:17.981073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:17.981532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:17.981957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.047258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.056237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.058332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.058991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-66061d26-d3f4-4abf-b806-00925adf19cc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090856 Oct 19 13:35:18.059554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1140/2212] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:18.813572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:18.814289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:18.816634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=80 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:18.822361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.822830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.823257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.824026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.824490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.824903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.881059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:18.881626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:18.888948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.889486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.889921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.890641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:18.895148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:18.895148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:18.967512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:18.976414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c40d0a83-40c7-4065-992e-3d04eb9ff38d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166709 Oct 19 13:35:18.977211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1073/2213] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:19.024780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.033743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-04f01536-b848-49b5-b9d5-17d34cda902d tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.156655 Oct 19 13:35:19.034330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1141/2214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:18 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:19.084210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:19.084805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:19.091123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.091594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.092019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.092688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:19.093162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:19.093572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:19.108711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:19.159243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.168120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.169923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:19.171053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-858b97ae-3f7d-47a0-a1b3-c9d12d6c4b34 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090831 Oct 19 13:35:19.171617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1074/2215] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:20.000019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.000685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.007585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.008076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.008515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.009251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.009705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.010139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.057708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.058340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.065484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.065973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.066392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.067091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.067537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.067954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.154124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.163609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f7791631-9849-4fc6-9cfb-64fdfa9b042f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167940 Oct 19 13:35:20.164194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1142/2216] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:20.196618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:20.197298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:20.205599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.206307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.206755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.207502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:20.207963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:20.208390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:20.215145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.224786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fea230d9-470c-4965-a803-0d715a485ff8 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.171300 Oct 19 13:35:20.226691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1075/2217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:20 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:20.277048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.287533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.289102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:20.290256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-07f7139f-0edc-4b2f-9183-ff4d2debadbf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097579 Oct 19 13:35:20.290813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1143/2218] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:21.188398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:21.189203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:21.196360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.196835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.197294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.198047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.198472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.198904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.249943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:21.250564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:21.257794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.258281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.258706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.259370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.259921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.260337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.335548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.344051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4a157a39-6c6d-4ebc-857c-9ffb147b49d7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159570 Oct 19 13:35:21.344647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1076/2219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:21.349643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:21.350484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:21.356628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.357247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.357912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.358692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:21.359234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:21.359771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:21.396685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.405522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb356a8b-57a2-465a-9532-c434a77faae7 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159716 Oct 19 13:35:21.406137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1144/2220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:21 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:21.425577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.434260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.435675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:21.436803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-14e614cb-bfd6-4678-abf8-83b161ca8156 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090704 Oct 19 13:35:21.437399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1077/2221] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:21 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:22.367390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:22.367966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:22.375079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.375588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.376018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.377046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.378021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.378356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.429688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:22.430302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:22.437119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.437620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.438042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.438755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.439291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.439956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.512797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.522410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c525927e-cc07-42d8-b357-ca5397a2a670 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158993 Oct 19 13:35:22.522980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1145/2222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:22.527608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:22.528503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:22.535482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.535968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.536397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.537227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:22.537582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:22.538173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:22.576804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.586071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-876266cd-f2b0-4ea4-8371-21772f2ed6af tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.160158 Oct 19 13:35:22.597148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1078/2223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:22 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:22.603374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.613589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.616285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:22.617514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b8bb820e-738a-480c-8439-4bba89fe9fbd tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093561 Oct 19 13:35:22.618087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1146/2224] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:23.546266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.546895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.554182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.554658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.555092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.555776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.556225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.556639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.609812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.610402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.617401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.617883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.618291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.619019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.619465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.619881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.687598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.696657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-30c21003-3cff-4d82-9d75-c1708d0f00f7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154346 Oct 19 13:35:23.697258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1079/2225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:23.702145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:23.702747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:23.709334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.709814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.710240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.710931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:23.711369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:23.711792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:23.751415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.759805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dd2638b2-f870-4641-be64-4aa5bac1a036 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.153937 Oct 19 13:35:23.760405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1147/2226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:35:23.778066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.787373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.788808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:23.790005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fe1b47c3-1745-4759-b96c-209e54be626e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091838 Oct 19 13:35:23.790558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1080/2227] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:24.720099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:24.720958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:24.727912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.728399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.728854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.729563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.730013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.730439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.783537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:24.784164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:24.791048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.791531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.791961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.792657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.793135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.793546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.864473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.873637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a3b330f-9266-46ae-8ef6-8ea6533cab70 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157565 Oct 19 13:35:24.874360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1148/2228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:24.879520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:24.880140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:24.886344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.886822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.887274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.887958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:24.888423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:24.888992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:24.927114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.935576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0ed6becf-2952-434c-8282-0fc0c4a094c3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.156229 Oct 19 13:35:24.936143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1081/2229] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:24 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:24.958413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.967416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.968850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:24.970025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0974872c-79ca-40fc-817a-58e0e3a7a7f8 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094929 Oct 19 13:35:24.971262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1149/2230] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:25.896521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:25.897144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:25.904485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.904984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.905414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.906096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.906537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.906956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.959449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:25.960121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:25.967140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.967627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.968035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:25.968759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:25.969246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:25.969668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.043112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.052682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2f92838-b527-412c-89fe-22f24e8a0500 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160043 Oct 19 13:35:26.053283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1082/2231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:26.057725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:26.058315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:26.064540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.065054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.065511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.066203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:26.066643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:26.067053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:26.103752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.112328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8a1a297f-8901-4cb5-a79c-9a093e8c5b47 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.157378 Oct 19 13:35:26.112931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1150/2232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:25 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:26.132123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.140987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.142400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:26.143545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-be603704-cc8e-41fb-a0ba-5a8357dc401a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089326 Oct 19 13:35:26.144095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1083/2233] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:27.076377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:27.077001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:27.084113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.084602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.085093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.085788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.086266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.086671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.135877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:27.136519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] [instance: 0bb468a8-83a3-4574-859c-72e04d9ab535] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:27.143747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.144234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.144675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.145386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.145829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.146241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.225082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.233551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52640bfb-cfda-4af0-9c60-16934599a6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161287 Oct 19 13:35:27.234127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1151/2234] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:27.239323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:27.239928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:27.246638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.247131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.247591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.248997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:27.248997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:27.249521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:27.282284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cefc194397440018b2c8f1d11d9a445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355a62e6646d4d258d3abc95e7149178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.291298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-af11f3f8-f771-44c9-9ab5-0dee0d0ffcc3 tempest-VolumesSnapshotTestJSON-1518887303 tempest-VolumesSnapshotTestJSON-1518887303-project] 10.222.0.17 "GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535" status: 200 len: 1559 microversion: 2.1 time: 0.159314 Oct 19 13:35:27.291887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1084/2235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:27 2022] GET /compute/v2.1/servers/0bb468a8-83a3-4574-859c-72e04d9ab535 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:27.315096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.323997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.325486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:27.326722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3a7285ba-02e0-40db-ac72-e2c8671c4017 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091616 Oct 19 13:35:27.327232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1152/2236] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:28.258201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:28.258771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:28.266166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.266642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.267331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.268099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.268542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.268985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.351944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:28.352590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:28.359659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.360140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.360586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.361326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:28.361746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:28.362162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:28.401589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.411084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-523d2204-2a53-46da-aa7e-04449dc85884 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156757 Oct 19 13:35:28.411672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1085/2237] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:28.424773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.433695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.435137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:28.436291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb9c1307-b095-47b6-b327-d1a74f550f93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088409 Oct 19 13:35:28.436854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1153/2238] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:29.435207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:29.435828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:29.442939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.443417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.443846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.444531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.445015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.445433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.461908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:29.462506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:29.469772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.470559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.471382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.472126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:29.472583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:29.473041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:29.475936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:29.538970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.548809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.551007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.551803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8db801f7-14d8-441f-ba25-ce7a7342c5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093984 Oct 19 13:35:29.552342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1154/2239] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:29.582887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:29.591256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eca4a07e-bab4-4572-a8bd-ad6fbf5937b1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160078 Oct 19 13:35:29.591812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1086/2240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:30.577469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:30.578059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:30.585390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.585878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.586313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.586997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.587442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.587859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.614605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:30.615229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:30.622559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.623131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.623667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.624540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:30.625107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:30.625584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:30.653938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.663072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.664524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.665699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dabcd057-69d9-46a1-b8c5-3e6c0eae902f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092348 Oct 19 13:35:30.666253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1155/2241] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:30 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:30.755931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:30.764481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f256c444-c4da-479a-b2f1-ed4bdea18487 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154176 Oct 19 13:35:30.765075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1087/2242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:31.691215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:31.691833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:31.698829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.699323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.699758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.700450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.700910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.701361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.788475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:31.789152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:31.796296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.796781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.797576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.798315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:31.798769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:31.799218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:31.943675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:31.952501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-26d8e7ee-f59a-493a-bd99-34544064d1f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167937 Oct 19 13:35:31.953209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1088/2243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:31.998835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.008042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.009543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:32.010699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-227d585b-248f-4319-96ed-68c6d6ebdcfc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.323969 Oct 19 13:35:32.011268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1156/2244] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:32.976808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:32.977492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:32.984184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:32.984664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:32.985109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:32.986032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:32.986490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:32.986912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.036841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:33.037528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:33.044326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.044810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.045271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.045965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:33.046417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:33.046839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:33.110337 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.119551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.121355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.122516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d1972d3d-e11e-4f6b-be12-2f2f8ac183ec tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089863 Oct 19 13:35:33.123078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1157/2245] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:33.127064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:33.135589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6071a54f-f611-434a-a73b-40f82729085e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162817 Oct 19 13:35:33.136153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1089/2246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:34.149162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:34.149798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:34.159986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.160630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.161369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.161537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:34.162104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.162342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:34.162800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.163491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.170962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.171439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.171992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.172965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:34.173746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:34.173875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:34.233970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.243322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.244885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.246436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a3d7b26d-bcd5-4ea2-8416-a5f8c3fe41dc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.101551 Oct 19 13:35:34.247250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1158/2247] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:34.307202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:34.316258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d98ff73f-0d71-42aa-9ba1-866d236ea19f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160792 Oct 19 13:35:34.316838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1090/2248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:35.273301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:35.273940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:35.281175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.281671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.282111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.282989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.283500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.283994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.342112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:35.342757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:35.347072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.349216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.349700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.350126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.350817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:35.351272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:35.351684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:35.355805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:35.356440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.357802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.359007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e7bf91b3-cc04-4e9d-97ea-675a449c4263 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089892 Oct 19 13:35:35.359946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1159/2249] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:35.484779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:35.495182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-88c8df0e-5353-4bdc-b5b4-8eeaf6d668af tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156760 Oct 19 13:35:35.496372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1091/2250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:36.389100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:36.390185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:36.397699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.398181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.398617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.399330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.399776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.400173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.472976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.482144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.483669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.484837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e263c715-6179-4320-a9b3-cb6bb2840aa0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102126 Oct 19 13:35:36.485427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1160/2251] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:36.522619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:36.523227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:36.533059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.533605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.534009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.535029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:36.535706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:36.536327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:36.677160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:36.689927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ac98707d-20c3-4d47-b79f-b974f13928e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.171255 Oct 19 13:35:36.690491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1092/2252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:37.511999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:37.512646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:37.519630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.520121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.520563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.521301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.521763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.522192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.585902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.594952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.596643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.597816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60ce5de7-89be-4087-a8c7-a2ca9c8310da tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089828 Oct 19 13:35:37.598381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1161/2253] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:37.713299 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:37.713928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:37.721172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.721654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.722086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.722776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:37.723252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:37.723669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:37.868042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:37.877134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b497bf1-70c3-41d1-8120-c627d3abe7c7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.167686 Oct 19 13:35:37.877700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1093/2254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:38.624308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:38.624910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:38.631959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.632449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.632891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.633611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.634067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.634491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.699745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.709134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.710582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:38.711736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e2ecfd1f-bbb4-47df-ba23-fe9c2aa06afa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092400 Oct 19 13:35:38.712341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1162/2255] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:38.902990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:38.903579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:38.911933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.912406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.912833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:38.913613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:38.914052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:38.914469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.043918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.052340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ee477632-5c0d-4063-8856-1d39c5cf68cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155800 Oct 19 13:35:39.052886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1094/2256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:39.738671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:39.739610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:39.751021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.751951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.752463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.753219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:39.753655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:39.754080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:39.816564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.825745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.827197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:39.828348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4480cf66-bea2-410a-9a7e-2000c93844bc tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.096383 Oct 19 13:35:39.828906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1163/2257] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:40.077484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:40.078105 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:40.085239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.085720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.086151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.086839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.087283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.087695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.228568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.237215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1afca327-5d94-4155-916f-4df0664f7362 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163738 Oct 19 13:35:40.237800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1095/2258] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:40.853007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:40.853598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:40.860313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.861052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.861780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.862505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:40.862965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:40.863396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:40.938791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.948214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.949785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:40.951158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7117a2a0-5931-473d-9968-0b44aae925e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102161 Oct 19 13:35:40.951676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1164/2259] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:40 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:41.260661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:41.261418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:41.268473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.268970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.269393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.270078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.270518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.270925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.406897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:41.415827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-824d61f0-5d39-4033-8f39-1680751287d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159017 Oct 19 13:35:41.416539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1096/2260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:41.976722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:41.977410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:41.984278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.984755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.985216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:41.985899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:41.986417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:41.986835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:42.052414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.061222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.062655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.063962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba06b74c-1dde-4845-8cc2-95794084da35 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091150 Oct 19 13:35:42.065073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1165/2261] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:42.439713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:42.440395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:42.447317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:42.447791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:42.448214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:42.448900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:42.449364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:42.449776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:42.586129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:42.594752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ebe89c09-81c9-464f-baed-712e0f672127 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159080 Oct 19 13:35:42.595743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1097/2262] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:43.090058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:43.090694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.098620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.099106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.099546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.100241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.100718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.101178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.164408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.173981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.175433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.176618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78ec7b3d-5469-47da-80a1-2072951895eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090518 Oct 19 13:35:43.177203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1166/2263] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:43.618386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:43.619059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:43.626165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.626838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.627268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.627945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:43.628393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:43.628794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:43.762666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:43.771671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8edd7a49-f2fe-4471-8a2f-3ccf25d16216 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157268 Oct 19 13:35:43.772246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1098/2264] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:44.202947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:44.203581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:44.211070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.211556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.211999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.212688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.213155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.213603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.281571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.291769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.293262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.294426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-95f91879-fd68-4ec6-9562-1b5b2a4fc357 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095513 Oct 19 13:35:44.294991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1167/2265] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:44.794962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:44.795611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:44.803381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.803870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.804295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.805052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:44.805496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:44.805911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:44.944043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:44.952994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c16cec0-703e-425a-81c3-a6f2da09bbfd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162041 Oct 19 13:35:44.953564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1099/2266] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:45.319556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:45.320160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:45.327154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.327634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.328063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.328757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.329234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.329881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.394380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.403682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.405140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:45.406296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb9a5e9f-ba18-42b8-8ac9-a8f261bfe0aa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090750 Oct 19 13:35:45.406856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1168/2267] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:45.975923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:45.976541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:45.983315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.983823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.984244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:45.984926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:45.985391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:45.985958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.128599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.137325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b681270f-ec41-449d-bd71-82cf88b0d825 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165055 Oct 19 13:35:46.138107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1100/2268] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:46.431588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:46.432174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:46.434569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=64 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:46.440313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.440792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.441246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.441940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:46.442356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:46.442800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:46.507533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.516362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.518075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:46.519216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d5bb6524-ecb4-45cc-aa15-6a89299bbb84 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091861 Oct 19 13:35:46.519776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1169/2269] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:47.161721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:47.162366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:47.168888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.169352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.169769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.170471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.170907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.171326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.307062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.316083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ef7f20b2-3ad8-433b-acfe-51a8084aaca8 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158509 Oct 19 13:35:47.316645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1101/2270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:47.544190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:47.544818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:47.552061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.552553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.553051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.553757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:47.554210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:47.554642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:47.625062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.627304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:47.635505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.636967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:47.638126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7e673b0b-736d-4e99-b401-cf32ea2ba993 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097981 Oct 19 13:35:47.638688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1170/2271] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:48.339477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:48.340081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:48.347099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.347572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.347989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.348669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.349145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.349565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.481643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:48.490552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-503ba87c-1394-47b9-b2de-335abac8d631 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155006 Oct 19 13:35:48.491123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1102/2272] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:48.663175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:48.663778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:48.670636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.671117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.671533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.672214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:48.672665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:48.673105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:48.736813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:48.746475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:48.747893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:48.749070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4a521386-2b35-497f-a51e-1e42a43c9c60 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090139 Oct 19 13:35:48.749613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1171/2273] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:49.514389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:49.515021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:49.518639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=60 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:49.524052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.524590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.525333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.526021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.526464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.526879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.660657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.671594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3e022413-3fa8-406f-a0ca-316363d8d2e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160831 Oct 19 13:35:49.672459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1103/2274] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:49.774932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:49.775567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:49.782575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.783066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.783483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.784418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:49.784890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:49.785312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:49.848506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.857648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.859002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:49.860134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-74ed54bb-c494-486d-a993-9c3a8a389719 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089446 Oct 19 13:35:49.860716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1172/2275] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:49 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:50.695942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:50.696576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:50.703457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:50.703936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:50.704445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:50.705269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:50.705719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:50.706137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:50.837267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:50.845961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f18112d7-3c5d-461a-bca0-0b959cb69f8c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153898 Oct 19 13:35:50.846503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1104/2276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:50.885746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:50.886289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:50.894086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:50.894086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:50.894745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:50.895892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:50.896633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:50.897332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:50.963508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:50.972732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:50.974189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:50.975324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4568bac7-a68e-47a8-86b1-b8108f8c8cab tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093733 Oct 19 13:35:50.975891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1173/2277] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:51.870062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:51.871034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:51.878672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:51.879150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:51.879573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:51.880260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:51.880704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:51.881147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:52.000358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:52.001132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:52.007532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:52.008018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:52.008453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:52.009151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:52.009621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:52.010040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:52.020079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:52.028705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7221ea42-ea86-4492-8a99-0fb1e4bb588a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162631 Oct 19 13:35:52.029323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1105/2278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:52.075597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:52.084680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:52.086137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:52.087283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e58f8028-c78e-45a8-894f-c0058413fd28 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091066 Oct 19 13:35:52.087839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1174/2279] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:53.052599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:53.053243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:53.060180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.060657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.061197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.061882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.062324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.062736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.111633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:53.112268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:53.118957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.119437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.119870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.120917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:53.121397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:53.121814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:53.184418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:53.194576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:53.196110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:53.198104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ef8e46c7-3116-49ff-948a-14c7345d0b3e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090451 Oct 19 13:35:53.198761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1175/2280] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:35:53.199212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:53.207980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a4881aa5-15e4-4349-88f4-e1b3d2a356b2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159286 Oct 19 13:35:53.208546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1106/2281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:54.223044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:54.223628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:54.230212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:54.230695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:54.231128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:54.231816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:54.232134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:54.232606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:54.232606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:54.232811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:54.240111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:54.240589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:54.241049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:54.241947 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:54.242390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:54.242800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:54.296620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:54.306291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:54.307736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:54.308896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-818de658-8c0c-4769-88fe-1d04eede8b8a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089970 Oct 19 13:35:54.309485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1176/2282] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:54 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:54.433464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:54.435723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:35:54.443447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e583100f-b78c-41d2-bf94-a248fa2979a4 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.215686 Oct 19 13:35:54.444019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1107/2283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:55.333788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:55.334381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:55.341798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.342278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.342709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.343395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.343843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.344259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.412914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:55.422353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:55.424515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:55.425698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0f2acea3-5811-456f-ae75-49365e7fc82a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095900 Oct 19 13:35:55.426229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1177/2284] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:55 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:55.466857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:55.467447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:55.474656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.475138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.475569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.476252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:55.476698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:55.477150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:55.610300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:55.619431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fae79c0c-4e31-4ece-91cc-615dfb44106d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156544 Oct 19 13:35:55.619970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1108/2285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:56.450657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:56.451373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:56.458845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.459350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.459784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.460474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.460953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.461370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.527002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:56.536139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:56.537601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:56.538743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-29156c02-2f65-4c8a-994a-66b720611193 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092449 Oct 19 13:35:56.539304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1178/2286] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:56 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:56.643271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:56.643875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:56.650840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.651346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.651768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.652450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:56.652894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:56.653337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:56.796439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:56.804731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7a4f2093-b337-44ba-bc6c-5d4756e01b3f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165547 Oct 19 13:35:56.805322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1109/2287] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:57.567590 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:57.568171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:57.575048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.575550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.575978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.576664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.577148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.577563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.641378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:57.651115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:57.652540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:57.653916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-25ae880d-dd6c-40ad-85e4-c24e2534b278 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090787 Oct 19 13:35:57.654474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1179/2288] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:57 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:57.828679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:57.829371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:57.836603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.837115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.837551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.838235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:57.838686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:57.839102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:57.976195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:57.984817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4164b48b-8a76-4bc2-a314-65e571efc02f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160218 Oct 19 13:35:57.985446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1110/2289] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:58.679374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:58.680023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:58.687234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:58.687719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:58.688161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:58.688886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:58.689365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:58.689788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:58.759174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:58.768415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:58.769903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:58.771043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-79aec633-17a2-47c3-b9b8-91960f3dd350 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095674 Oct 19 13:35:58.771599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1180/2290] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:58 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:35:59.009203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:59.009827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:59.016588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.017116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.017540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.018219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.018659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.019067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.154625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:59.163482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b0160370-6798-4871-9232-acea5ed5c718 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158258 Oct 19 13:35:59.164049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1111/2291] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:35:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:35:59.795858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:35:59.796449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:35:59.803586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.804071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.804507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.805245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:35:59.805701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:35:59.806127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:35:59.869629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:59.878979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:59.880415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:35:59.881599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bab61caf-23c5-4b51-bd36-3ee391c03af4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089750 Oct 19 13:35:59.882158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1181/2292] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:35:59 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:00.187285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:00.187931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:00.195173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.195646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.196066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:00.196745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.197212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.197624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:00.334382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:00.342995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2aae76b9-e980-404e-add1-ed184d213c72 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159626 Oct 19 13:36:00.343570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1112/2293] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:00 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:00.906982 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:00.907735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:00.914691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.915179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.915617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:00.916286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:00.916762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:00.917221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:00.984055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:00.993847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:00.995614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:00.996759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5c9336e-9c01-44cb-b6fb-0db8f0c8eb88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093854 Oct 19 13:36:00.997374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1182/2294] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:00 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:01.367099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:01.367735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:01.374900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:01.375383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:01.375821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:01.376553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:01.377039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:01.377454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:01.510595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:01.519213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9aa7a1c3-f026-4234-96f3-e239b6e21912 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156110 Oct 19 13:36:01.519785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1113/2295] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:02.022949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:02.023587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:02.030468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.030964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.031398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.032214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.033296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.033729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.097218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:02.106064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:02.107490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:02.108638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2ef8affb-4282-4e77-bf17-22f22fe2ccb0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089760 Oct 19 13:36:02.109229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1183/2296] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:02 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:02.542989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:02.543589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:02.550962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.551436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.551857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.552537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:02.553005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:02.553419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:02.686244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:02.695074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9fa628c1-3c57-4d18-a9c0-a6aca0a9e75c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156002 Oct 19 13:36:02.695642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1114/2297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:03.134498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:03.135496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:03.143149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.143669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.144081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.144809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.145298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.145721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.214250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:03.223381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:03.224817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:03.226004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d1c80340-a8f6-4e03-8ff8-3d944cb4ef4f tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095519 Oct 19 13:36:03.226568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1184/2298] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:03 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:03.717995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:03.718642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:03.725586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.726059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.726487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.727162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:03.727637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:03.728054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:03.878392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:03.890551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7f2e82d7-837e-45c1-a9c6-54f5094b2894 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.176149 Oct 19 13:36:03.891349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1115/2299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:04.252267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:04.252934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:04.259861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.260287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.260680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:04.261443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.261879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.262300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:04.326985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:04.336252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:04.337731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:04.338875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c9bebc04-9d58-4317-a706-8e07d70a33eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090953 Oct 19 13:36:04.339432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1185/2300] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:04 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:04.915146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:04.915770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:04.922559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.923045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.923474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:04.924165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:04.924612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:04.925071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:05.058197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:05.066982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ebb8fe57-4807-457c-8bdc-aa3879ae4543 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155853 Oct 19 13:36:05.067543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1116/2301] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:05.364464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:05.365099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:05.372472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:05.372992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:05.373410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:05.374127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:05.374581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:05.375007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:05.445245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:05.454265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:05.456200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:05.457398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-16277302-e6a9-4759-90f5-b20ea9294297 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097340 Oct 19 13:36:05.457958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1186/2302] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:05 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:06.090624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:06.091279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:06.098206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.098682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.099109 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.099790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.100234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.100646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.238608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:06.247513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57e2f6c7-5686-4553-b142-cef818060f19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160784 Oct 19 13:36:06.248099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1117/2303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:06.487394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:06.488294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:06.500383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.501292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.501883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.502564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:06.503056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:06.503524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:06.519482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:06.567774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:06.576709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:06.578193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:06.579396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bcb404f3-a112-42d6-ac20-e4390e2e6161 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098836 Oct 19 13:36:06.579965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1187/2304] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:06 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:07.274181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:07.274770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:07.284229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.284708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.285177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:07.285868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.286307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.286745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:07.416821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:07.425901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a10e3db9-3778-40ae-8582-bec621aac8db tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157604 Oct 19 13:36:07.426481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1118/2305] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:07.605512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:07.606100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:07.613003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.613484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.613900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:07.614579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:07.615074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:07.615491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:07.678546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:07.687595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:07.689055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:07.690480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ab896da2-708a-4542-b579-d7a5997c08e7 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088988 Oct 19 13:36:07.691404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1188/2306] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:07 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:08.448979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:08.449666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:08.456435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:08.456913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:08.457371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:08.458060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:08.458511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:08.458930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:08.593716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:08.602329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-651094eb-a958-42b3-884d-44abe3d4d357 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157300 Oct 19 13:36:08.602893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1119/2307] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:08.717132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:08.717773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:08.720184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:36:08.720334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 (ip 10.222.0.17) !!! Oct 19 13:36:08.727074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:08.727556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:08.727994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:08.728691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:08.729267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:08.730045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:08.793861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:08.807794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:08.809303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:08.810464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b70b643c-91f1-4378-851f-fd990ca7a9d9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097421 Oct 19 13:36:08.811029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1189/2308] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:08 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:09.626436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:09.627050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:09.634233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.634758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.635162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.635829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.636303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.636717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.769034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:09.777644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-688a69d5-6ecb-4d2d-8e69-69ae67f8361b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155243 Oct 19 13:36:09.778209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1120/2309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:09.835820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:09.836547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:09.843524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.844006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.844441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.845171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:09.845619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:09.846040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:09.914411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:09.923781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:09.925369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:09.926526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f28cb4aa-9f76-48c3-b28e-e22729112c6c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094728 Oct 19 13:36:09.927095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1190/2310] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:09 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:10.802643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:10.803262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:10.805301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:36:10.805451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:36:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa (ip 10.222.0.17) !!! Oct 19 13:36:10.812483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.813054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.813485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.814194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.814670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.815076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.952081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:10.952711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:10.959932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.960423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.960854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.961591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:10.962053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:10.962476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:10.965825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:10.974567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-394ae629-15ea-4bb9-a21e-fcb74a248465 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.176339 Oct 19 13:36:10.975159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1121/2311] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:11.026753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:11.035718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:11.037160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:11.038304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6c26d538-2c00-4bbb-9abb-e2e44a25e136 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090521 Oct 19 13:36:11.038850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1191/2312] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:10 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:11.999749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:12.000402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:12.007151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.007624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.008044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.008720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.009190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.009574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.062654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:12.063280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:12.070515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.071007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.071451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.072210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:12.073035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:12.073468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:12.137164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:12.146959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:12.148411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:12.149621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cd3b375c-e291-4732-bb0f-474464737c57 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091020 Oct 19 13:36:12.150204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1192/2313] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:12 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:12.151644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:12.160228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e20f8a5d-96c1-4ecf-b398-b8702585d5bd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164398 Oct 19 13:36:12.161101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1122/2314] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:13.175764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:13.176460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:13.183449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.184031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.184472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.185287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.185745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.186171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.188918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:13.189555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:13.197245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.197740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.198166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.198857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:13.199304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:13.199716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:13.250298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:13.260102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:13.261700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:13.262999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-38385c43-e9f2-47b1-9d21-d43cfa1b33b2 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091352 Oct 19 13:36:13.263678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1193/2315] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:13 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:13.334526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:13.343015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ef5f059c-2933-4446-b585-68c3e7b43e36 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157927 Oct 19 13:36:13.343563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1123/2316] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:14.289583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:14.290413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:14.297595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:14.298086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:14.298524 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:14.299254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:14.299711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:14.300357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:14.366320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:14.366924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:14.367104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:14.374585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:14.375569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:14.376245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:14.377381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:14.377774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:14.377930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:14.378778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:14.379909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:14.381328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b6d48bd-6bb9-40aa-863f-df18b5c6c08e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095903 Oct 19 13:36:14.382092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1194/2317] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:14 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:14.395533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:14.527605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:14.538110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb0f8c28-007a-422d-a87d-38f06d5512d6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.175710 Oct 19 13:36:14.538684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1124/2318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:15.407218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:15.407863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:15.409910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:36:15.410098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 (ip 10.222.0.17) !!! Oct 19 13:36:15.417308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.417806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.418248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.418952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.419411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.419836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.489575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:15.499329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:15.500764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:15.501949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6473a49e-b0d9-4f71-a243-bdf3b4b5d474 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.098773 Oct 19 13:36:15.502525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1195/2319] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:15 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:15.565189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:15.566368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:15.572806 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.573326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.573761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.574458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:15.574910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:15.575328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:15.705360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:15.714209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e405850e-e7c8-4557-8b2e-9a4a44b79642 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153003 Oct 19 13:36:15.714785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1125/2320] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:16.529335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:16.529906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:16.532229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=54 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:16.538065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.538545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.538978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.539671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.540121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.540543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.608737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:16.618513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:16.620372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:16.621529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-95f4ae69-b0cd-4ecd-9e80-5411175cf7ed tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097551 Oct 19 13:36:16.622089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1196/2321] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:16 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:16.739465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:16.741067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:16.750796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.751564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.752248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.753430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:16.754182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:16.754635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:16.887391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:16.899026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a8aab278-a514-4a57-923a-4b5f27107345 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165081 Oct 19 13:36:16.899680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1126/2322] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:17.647349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:17.647955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:17.657880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.658690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.659492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:17.660604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.661092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.661523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:17.733320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:17.742416 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:17.743911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:17.745487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28c44e55-fe7e-4e91-8228-94a471fe540c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102552 Oct 19 13:36:17.746049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1197/2323] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:17 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:17.923177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:17.923807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:17.930816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.931622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.931788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:17.932419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:17.932887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:17.933330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.087995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.096347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6637d1ae-1629-437b-9f0a-6d6cb63d6464 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.177272 Oct 19 13:36:18.096953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1127/2324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:18.770341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:18.770935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:18.777978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.778440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.778968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.779611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:18.780058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:18.780476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:18.845957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.856011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.857487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:18.858634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-523cabfa-f6a1-448f-91aa-dfcd9e9aa2f9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092582 Oct 19 13:36:18.859199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1198/2325] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:18 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:19.120210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:19.120832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:19.127801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.128404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.129119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.129864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.130312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.130728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.261414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.270732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-df029f54-d1ac-4b1a-9d5f-6221d4f094d9 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154766 Oct 19 13:36:19.271317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1128/2326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:19.885050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:19.885727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:19.892975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.893591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.894139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.895043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:19.895489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:19.895974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:19.962476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.972288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.973773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:19.974978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f6611330-613c-48c8-9b5a-928a2780f8c4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094019 Oct 19 13:36:19.975515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1199/2327] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:19 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:20.294040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:20.294669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:20.297336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=52 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:20.303176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:20.303664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:20.304090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:20.304766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:20.305259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:20.305647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:20.464598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:20.473336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f6488e79-b2e7-4dfc-926a-d80864ec5854 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.183535 Oct 19 13:36:20.473909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1129/2328] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:20 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:21.003973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:21.004667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:21.011502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.011989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.012427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.013155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.013611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.014040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.076630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.086314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.087754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.088898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-133f5e62-8ee8-45a9-9d3c-e40acbebfc53 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089532 Oct 19 13:36:21.089483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1200/2329] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:21.497585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:21.498170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:21.505395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.505903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.506386 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.507078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:21.507495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:21.508300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:21.640108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:21.649133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9aac377a-30a7-4e6f-aad0-929aea7ce882 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155842 Oct 19 13:36:21.649699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1130/2330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:22.114110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:22.114743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:22.122092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.122583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.123017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.123714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.124164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.124596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.187468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.197025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.198451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.199601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5db33b37-cc58-4673-a25e-85e06a6ae381 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089514 Oct 19 13:36:22.200158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1201/2331] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:22 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:22.673586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:22.674162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:22.681297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.681883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.682317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.682999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:22.683441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:22.683855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:22.819599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:22.828434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2e343110-5d63-498a-b3db-38d21e4c8814 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158711 Oct 19 13:36:22.829063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1131/2332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:23.224599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:23.225308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:23.232383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.232903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.233342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.234046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.234504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.234957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.303000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:23.312238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:23.313714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:23.314879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-99f89f91-231e-44b9-9f75-1b2e603290b5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094395 Oct 19 13:36:23.315582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1202/2333] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:23 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:23.851845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:23.852405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:23.859931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.860408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.860831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.861860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:23.862525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:23.863009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:23.996166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.004540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d0a2013e-b148-4965-8b57-fd01e7a13055 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156645 Oct 19 13:36:24.005135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1132/2334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:24.341230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:24.341809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:24.349106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.349569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.350022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.350718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:24.351165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:24.351587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:24.416325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.425704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.427137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:24.428291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-da8745fb-4422-4bd5-bfb8-765a68aa693e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091156 Oct 19 13:36:24.428850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1203/2335] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:24 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:25.028185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:25.028771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:25.036369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.036889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.037317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.038003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.038448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.038859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.171193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.180015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35844b5c-05f8-4aac-a432-05199b5e4b93 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155870 Oct 19 13:36:25.180614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1133/2336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:25.454045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:25.454660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:25.462040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.462529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.462966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.463668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:25.464118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:25.464539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:25.467170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:25.528478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.537788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.539238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:25.540393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e508135f-71ae-4fba-b771-722c562b21fa tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.090351 Oct 19 13:36:25.540979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1204/2337] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:25 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:26.203794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:26.204442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:26.211889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.212367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.212792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.213506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.213948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.214363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.349462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:26.358053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-aa8839c9-d3b6-4841-ae60-a0e9517df1ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158279 Oct 19 13:36:26.358650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1134/2338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:26.566302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:26.566937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:26.573940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.574431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.574865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.575566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:26.576018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:26.576449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:26.639476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:26.648662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:26.650214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:26.651366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-014313e8-c075-486a-a291-e70343344722 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089258 Oct 19 13:36:26.651929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1205/2339] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:26 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:27.383234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:27.383814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:27.390855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.391344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.393308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.393308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.393308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.393946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.525391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:27.533650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ed6ce607-2006-4fa6-934b-f15a8419950f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154432 Oct 19 13:36:27.534301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1135/2340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:27 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:27.678638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:27.679203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:27.686038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.686520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.686952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.687635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:27.688081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:27.688501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:27.754871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:27.763668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:27.765140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:27.766283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-22f33fee-e14a-4e0b-8083-ebfda75d8b7a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092240 Oct 19 13:36:27.766860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1206/2341] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:27 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:28.557278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:28.557900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:28.564743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.565570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.565740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.566518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.566967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.567382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.702158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.711018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f7e06671-e0a5-4c5b-b18a-3e5e1910356a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157681 Oct 19 13:36:28.711564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1136/2342] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:28.791435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:28.792035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:28.799166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.799638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.800480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.801620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:28.802370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:28.803076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:28.870865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.880617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.882116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:28.883211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f197b004-548b-4ac1-ae06-1c36d0f93816 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095777 Oct 19 13:36:28.883792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1207/2343] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:28 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:29.735007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:29.735613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:29.737682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:36:29.737909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:36:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa (ip 10.222.0.17) !!! Oct 19 13:36:29.745023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.745509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.745939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.746643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.747095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.747517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.880449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.889403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62e3b6f0-c631-4903-9a7a-321d079cc298 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158259 Oct 19 13:36:29.889905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1137/2344] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:29.907715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:29.908352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:29.915482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.916072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.916510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.917248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:29.917713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:29.918135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:29.980567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.989765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.991244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:29.992444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-56b05596-8416-448f-a736-54222107e2a5 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088680 Oct 19 13:36:29.993034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1208/2345] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:29 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:30.913348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:30.913951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:30.920791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.921296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.921720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:30.922394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:30.922835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:30.923245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.018231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:31.019230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:31.026200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.026718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.027148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.027845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:31.028292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:31.028717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:31.059247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.067888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f6e9a20e-2e3a-43b3-866c-d43a5ba06af0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158709 Oct 19 13:36:31.068472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1138/2346] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:31.099613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.108553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.110135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:31.111284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-52da70f6-0228-435e-b3e0-c42243fbfa32 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.097287 Oct 19 13:36:31.111847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1209/2347] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:31 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:32.091405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:32.092057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:32.099077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.099561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.099992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.100682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.101160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.101580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.137357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:32.137976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:32.145168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.145659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.146100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.146803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:32.147252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:32.147677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:32.215673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.224660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.226203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.227363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9030a634-7ef8-4952-aa22-f85a0675acc3 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094426 Oct 19 13:36:32.227924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1210/2348] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:32 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:32.236921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:32.245930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ff6cbb28-6da2-434d-bd70-53d83a80de0e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158531 Oct 19 13:36:32.246503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1139/2349] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:33.252779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:33.253651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:33.260567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.261169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.261629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.262332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.262785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.263211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.270416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:33.271658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:33.278516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.279003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.279447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.280145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:33.280611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:33.281064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:33.328815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.338207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.340565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.342205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6cda707e-a3ff-4f56-8708-6e2c7f6bf5b4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093359 Oct 19 13:36:33.342731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1211/2350] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:33 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:33.415509 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:33.424050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-352aece0-f3bc-4ece-a133-d091c7f50b91 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157946 Oct 19 13:36:33.424592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1140/2351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:34.368021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:34.368673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:34.375865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.376344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.376773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.377503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.377928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.378350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.440684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:34.447293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:34.448005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:34.450096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:34.451526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:34.452665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-242d1178-6d1f-45f4-9221-4b810b090f0a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.088670 Oct 19 13:36:34.453238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1212/2352] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:34 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:34.455401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.456092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.456603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.457632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:34.458090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:34.458514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:34.461340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:34.594690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:34.603695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-03b45865-0946-4d7f-845f-b1ac1e0ee3ce tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160227 Oct 19 13:36:34.604311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1141/2353] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:34 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:35.479335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:35.479976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:35.487031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.487493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.487906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.488626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.489180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.489600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.555192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.565322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.566816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.567906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-05c2b6a8-3081-4292-adc0-70d5d9b0579c tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092636 Oct 19 13:36:35.568670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1213/2354] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:35 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:35.628221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:35.629042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:35.636013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.636488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.636899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.637614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:35.638061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:35.638471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:35.775057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:35.788639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49a85f80-af4e-48a8-8e9e-8e111b56b613 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164489 Oct 19 13:36:35.789240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1142/2355] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:36.593212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:36.593832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:36.600808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.601338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.601771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.602461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.602908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.603331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.677371 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:36.686772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:36.688191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:36.689365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-49ac5a99-9870-45b0-9720-1e9b53e6d100 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100259 Oct 19 13:36:36.690172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1214/2356] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:36 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:36.814808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:36.815457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:36.822383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.822864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.823291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.824100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:36.824843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:36.825584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:36.968219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:36.977290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-580b49fe-ffc7-4c88-89ab-5bc6d391b4b6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166543 Oct 19 13:36:36.977832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1143/2357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:37.715799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:37.716396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:37.723628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:37.724111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:37.724533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:37.725269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:37.725716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:37.726135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:37.791406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:37.801518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:37.802935 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:37.804073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e6045a62-6a73-48e6-a954-a53c45a7c76e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092407 Oct 19 13:36:37.804889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1215/2358] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:37 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:38.004704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:38.005342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:38.012904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.013388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.013914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.014635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.015098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.015528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.154389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:38.163073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3c9aab84-ab0e-4c3d-8224-b332a7d923e6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164282 Oct 19 13:36:38.163653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1144/2359] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:38.834835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:38.835497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:38.842564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.843077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.843513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.844222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:38.844680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:38.845134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:38.913748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:38.927206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:38.928636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:38.929828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1da212aa-0d9a-4735-98d1-54a3d9b5096b tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.100069 Oct 19 13:36:38.930394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1216/2360] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:38 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:39.187278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:39.188167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:39.195330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.195816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.196248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:39.196989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.197441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.197859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:39.333036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:39.345776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-39d18979-a3f9-45df-bbcf-b811e9c99b25 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162637 Oct 19 13:36:39.346580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1145/2361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:39.955479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:39.956112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:39.963846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.964326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.964753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:39.965468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:39.965936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:39.966633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.031248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:40.040269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:40.041755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:40.042912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bed12e91-803e-429b-93ff-f3447dcbcfb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091593 Oct 19 13:36:40.043510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1217/2362] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:39 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:40.371016 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:40.371872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:40.379148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.379883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.380251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.380984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:40.381433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:40.381850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:40.522752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:40.531503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7f46ce14-a52d-4e50-a9e6-19edb93f1c3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165111 Oct 19 13:36:40.532082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1146/2363] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:40 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:41.068398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:41.069050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:41.076094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.076575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.077050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.077735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.078181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.078605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.145922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:41.155053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:41.156480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:41.157648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5895a901-85be-450e-bf6c-f21402d5ab69 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.093596 Oct 19 13:36:41.158246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1218/2364] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:41 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:41.555751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:41.556366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:41.563334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.563835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.564267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.564993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:41.565445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:41.565868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:41.699581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:41.708302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-237a7beb-41df-4466-bc43-2ae0572b5154 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156534 Oct 19 13:36:41.708903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1147/2365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:42.184050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:42.184675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:42.192715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.193418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.193881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.194556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.195006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.195425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.257770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:42.266801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:42.268238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:42.269411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-efe607e2-2c5f-4849-9dd7-5c695f3755c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.089385 Oct 19 13:36:42.270537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1219/2366] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:42 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:42.732059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:42.732682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:42.740626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.741128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.741878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.742570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:42.743022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:42.743433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:42.884175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:42.893193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8525997c-764d-46fb-9053-b61f195b1e79 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165240 Oct 19 13:36:42.894040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1148/2367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:43.295629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:43.296273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:43.303613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.304105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.304549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:43.305288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.305729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.306156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:43.373972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:43.376334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:43.384568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:43.385985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:43.387128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c075d26a-16e4-4e24-82dd-bb7de5ee69f4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095533 Oct 19 13:36:43.387686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1220/2368] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:43 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:43.917685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:43.918329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:43.925202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.925692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.926108 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:43.927002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:43.927775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:43.928297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:44.067003 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:44.075548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-19fb911c-38df-4845-b28f-6660923c673b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161906 Oct 19 13:36:44.076116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1149/2369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:44.412782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:44.413437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:44.420405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:44.420900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:44.421349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:44.422066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:44.422514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:44.422933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:44.488676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:44.497938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:44.499366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:44.500475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c3a9f6d8-0377-4208-92e6-f1b42851dccf tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.092068 Oct 19 13:36:44.501057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1221/2370] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:44 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:45.100548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:45.101227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:45.110443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.111251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.111961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.113174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.114382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.114801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.250063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:45.258889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-047b546d-c648-4a61-9b4d-50c199de4819 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162801 Oct 19 13:36:45.259470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1150/2371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:45.526580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:45.527226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:45.537050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.537709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.538301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.539389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:45.540040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:45.540653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:45.621431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:45.630812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:45.632429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:45.633616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-262f795a-794a-49fa-8226-1ad422c2c0ca tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.111232 Oct 19 13:36:45.634176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1222/2372] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:45 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:46.283019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:46.283667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:46.291949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.292597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.293072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.293942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.294390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.294796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.456916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:46.469784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-91f87eff-c362-4301-879d-f36979e442a0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.190411 Oct 19 13:36:46.470656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1151/2373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:46.658704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:46.659383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:46.661865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=54 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:46.667502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.667995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.668435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.669160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:46.669610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:46.670037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:46.736347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:46.747149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:46.748583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:46.749764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d0f2d30e-46cd-48ef-a6ec-94be1810ac58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.095183 Oct 19 13:36:46.750340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1223/2374] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:46 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:47.503672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:47.504880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:47.511601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.512079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.512503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.513231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.513673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.514085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.650240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.659071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0311d5f2-5cbf-4e41-b648-abc77162f155 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161680 Oct 19 13:36:47.659665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1152/2375] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:47 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:47.774734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:47.775353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:47.782022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.782490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.783054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.783755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:47.784210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:47.784630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:47.861517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.871781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.873239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:47.874395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4c86e56b-9ba9-405e-9f1a-adb57de40fea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.103811 Oct 19 13:36:47.874929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1224/2376] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:47 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:48.683090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:48.683696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:48.690356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:48.690839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:48.691686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:48.692389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:48.692910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:48.693305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:48.827747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:48.836896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2c4b2d0a-a4d4-4449-a95f-13ddba9eae6f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157780 Oct 19 13:36:48.837667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1153/2377] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:48.899984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:48.900579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:48.907467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:48.907947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:48.908380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:48.909101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:48.909551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:48.909975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:48.982706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:48.992003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:48.993536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:48.995046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8d0d09cd-23db-4f97-93a5-6682de5fd272 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.099220 Oct 19 13:36:48.995612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1225/2378] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:48 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:49.860015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:49.860654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:49.867672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:49.868158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:49.868593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:49.869674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:49.870127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:49.870545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:50.001635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:50.010874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-89efceb7-4f8c-40bf-983a-7b1ae98c370a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154850 Oct 19 13:36:50.011447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1154/2379] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:50.019949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:50.020681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:50.026971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:50.027450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:50.027885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:50.028571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:50.029055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:50.029478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:50.091604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:50.100753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:50.102215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:50.103365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-056f49b2-b993-47ce-ac40-78ac16db00e0 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.087620 Oct 19 13:36:50.103932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1226/2380] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:50 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 13:36:51.034667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:51.035425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:51.037788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=52 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:51.043604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.044088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.044513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.045241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.045683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.046097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.128141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:51.128827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:51.136188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.136674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.137109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.137806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:51.138265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:51.138697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:51.188229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:51.196725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2a23d4c3-4d61-4e81-a023-9ebe835c3b6d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165956 Oct 19 13:36:51.197302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1155/2381] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:51.202586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:51.216357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:51.217810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:51.218950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9258afe3-e806-4c02-8bb4-f60cf0bcbf12 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.094805 Oct 19 13:36:51.219508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1227/2382] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:51 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:52.222018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:52.222753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:52.229969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.230448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.230878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.231570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.232023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.232442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.244444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:52.245711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:52.252493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.253139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.253853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.254323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:52.254785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:52.255207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:52.319186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:52.328381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:52.330154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:52.331862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0652ff0c-bd80-4408-83b0-8bb3fd1d93ea tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.091588 Oct 19 13:36:52.333275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1228/2383] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:52 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:52.383776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:52.392349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-65e1335a-c140-4688-af87-b76306d1581d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174302 Oct 19 13:36:52.392908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1156/2384] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:53.357409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:53.358018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:53.365358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.365838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.366277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.366971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.367473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.367937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.415747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:53.416420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:53.418512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:36:53.418686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:36:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa (ip 10.222.0.17) !!! Oct 19 13:36:53.425429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.426102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.426350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.427025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:53.427467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:53.427870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:53.444364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:53.453478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:53.454933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:53.456098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9e6f90e7-e5e4-4f2b-91bc-8a3b8863b637 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 200 len: 1444 microversion: 2.20 time: 0.102820 Oct 19 13:36:53.456664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1229/2385] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:53 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:53.482273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-51223f56-9443-4b14-bcac-313f6c5e10ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '.version_select at 0x7ff4f92aa040>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:53.509904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-51223f56-9443-4b14-bcac-313f6c5e10ae tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404079147" status: 204 len: 0 microversion: 2.20 time: 0.031076 Oct 19 13:36:53.510211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1230/2386] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Oct 19 13:36:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404079147 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 13:36:53.563373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:53.565863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=100 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:53.573780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ffcd3040-1348-40f0-ab98-b7e00499193a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161868 Oct 19 13:36:53.574360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1157/2387] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:53 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:54.591851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-42f295e8-db94-4aab-b393-98eb3aef95d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'create', calling method: .version_select at 0x7ff4fca863a0>, body: {"keypair": {"name": "tempest-keypair-430762613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq2R5T3PKuWfPa4Hs8i08Fsgv4wiFOHijGS6lRTGMNuOXCj0BaWT5K8d7TeEpsa+51HC2yk4mXJHx159m/nn336xCaZrsSJ+Pb7sRFPBaOB3sJuC4/JMmWmexPGNtY6zQ=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:54.598031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:54.599035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:54.605873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:54.606335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:54.606754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:54.607464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:54.607912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:54.608332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:54.611024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-42f295e8-db94-4aab-b393-98eb3aef95d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for project 0a5888bfc20042a791f6798975b860fd. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:36:54.616229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-42f295e8-db94-4aab-b393-98eb3aef95d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for user 7e6d95493f8e4b58a9a212999916e6b1 and project 0a5888bfc20042a791f6798975b860fd. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:36:54.642080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-42f295e8-db94-4aab-b393-98eb3aef95d4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054636 Oct 19 13:36:54.643018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1231/2388] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Oct 19 13:36:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 13:36:54.775607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:54.784677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f9d5c2d8-652f-4fe7-a4f5-cd53af71d652 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.190799 Oct 19 13:36:54.785693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1158/2389] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:55.138560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:55.139059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:55.145577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.146069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.146494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.147192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.147642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.148219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.174895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:36:55.278245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d913d41-d117-464a-be2c-85669f5abbd6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 204 len: 0 microversion: 2.1 time: 0.143250 Oct 19 13:36:55.279174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1232/2390] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:36:55 2022] DELETE /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:36:55.287833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:55.288748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:55.295658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.296261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.296738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.297600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.298028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.298439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.442218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:55.452033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2b4ce588-92ab-490a-8725-6cf35cdefe99 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1507 microversion: 2.1 time: 0.168217 Oct 19 13:36:55.452689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1159/2391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:55 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:55.810201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:55.811785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:55.819578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.820073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.820513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:55.821446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:55.821987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:55.822417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.372660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:56.382064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e43c02da-b310-4e9a-a97b-f2994db4e24e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.576166 Oct 19 13:36:56.382867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1233/2392] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:56.460114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-738122412", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fcb8410-cf5e-404e-8684-2e02d81730af"}], "security_groups": [{"name": "tempest-securitygroup--2086285725"}], "key_name": "tempest-keypair-430762613", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:56.476385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:56.477162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:56.484179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:56.484783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:56.485271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.485984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:56.486623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:56.487054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.580587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] validate_networks() for [('5fcb8410-cf5e-404e-8684-2e02d81730af', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:36:56.725419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:56.740634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ef555a2-01c0-416f-9511-55e76b7d2ab9 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 200 len: 1507 microversion: 2.1 time: 0.268855 Oct 19 13:36:56.742376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1234/2393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:56 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:56.823566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2c13-c71c-4471-b5a4-0b9ea8898613", "name": "network-vif-deleted", "tag": "b55d3193-1cb5-4953-a286-2a0c4f3d5d2e"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:56.835891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:56.836556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:56.837026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:56.849179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] Creating event network-vif-deleted:b55d3193-1cb5-4953-a286-2a0c4f3d5d2e for instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 on hv-cinder-maste Oct 19 13:36:56.855659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-2162cda9-8c53-452f-8f4f-a08e05677451 req-02dbb64a-bad2-40b1-9345-62ffeebd3bcd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111754 Oct 19 13:36:56.856741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1235/2394] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:36:57.100072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:36:57.100538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:36:57.101256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:36:57.101694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:36:57.102085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:36:57.111434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.112014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.112591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.113625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.114180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.114748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.132728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for project 0a5888bfc20042a791f6798975b860fd. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:36:57.136937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Getting quotas for user 7e6d95493f8e4b58a9a212999916e6b1 and project 0a5888bfc20042a791f6798975b860fd. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:36:57.149090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:36:57.151451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:36:57.204045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4fd3419-fa4e-49e4-aa9d-e714fc273a92 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.748610 Oct 19 13:36:57.204683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1160/2395] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Oct 19 13:36:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 13:36:57.217148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.217864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.283948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:57.296181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:57.297630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:57.298772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d820aa0a-b86a-4207-a847-e86ffb9ed1eb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1280 microversion: 2.20 time: 0.085935 Oct 19 13:36:57.299327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1236/2396] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:57 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:57.417179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.418019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.424467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.424940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.425368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.426173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.427297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.427769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.569140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:57.579995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f874651d-3703-42fa-8e93-8e4679bea85a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.166857 Oct 19 13:36:57.580571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1161/2397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:57.765768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.766409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: f67d2c13-c71c-4471-b5a4-0b9ea8898613] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.773131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.773622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.774059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.774764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.775243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.775636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.789956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] HTTP exception thrown: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Request method failure captured: Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 HTTP/1.1 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_grUiWfjHcKRjENAP_RctiCr9kbAUsDzM_Qr_3wt-wOkw5_G71-z-4onc2teEAMBslvdhpHV4pXJTdRP6ZfWkj3xOqYQIV5LYc-J_Pv1yYr7cjxwKc02k2GAIi9BSd6eLY20KJY6b-PWU3AQrVZKHF1s2-Xrfh9GnfzBWkko6dYeoM Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:36:57.791692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3df7886f27d4ef48cb9031e75a15e46", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: f71530099a11440b9d69f550286d9614 Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. Oct 19 13:36:57.793565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'f67d2c13-c71c-4471-b5a4-0b9ea8898613'} Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:36:57.794713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. Oct 19 13:36:57.796633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:36:57.798189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Returning 404 to user: Instance f67d2c13-c71c-4471-b5a4-0b9ea8898613 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:36:57.798189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-33eb71b7-ecdb-4015-a847-003112206e1b tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613" status: 404 len: 111 microversion: 2.1 time: 0.031714 Oct 19 13:36:57.798189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1237/2398] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:57 2022] GET /compute/v2.1/servers/f67d2c13-c71c-4471-b5a4-0b9ea8898613 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:36:57.802614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.803127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.809802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.810276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.810702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.811961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.812453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.813019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.840170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:36:57.930001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e44475e5-950d-4186-8d2b-92417629bcb6 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 204 len: 0 microversion: 2.1 time: 0.131579 Oct 19 13:36:57.930743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1162/2399] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:36:57 2022] DELETE /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:36:57.938943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:57.939555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:57.946361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.946844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.947283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:57.947978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:57.948424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:57.948843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.084918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.092905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d90d55f-f962-4ddb-9f06-ac24b09e77f1 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1520 microversion: 2.1 time: 0.157807 Oct 19 13:36:58.093822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1238/2400] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:57 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:58.324487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:58.325227 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:58.331868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.332397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.332896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.333606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.334056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.334474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.403185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.412096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.413588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.414682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b4fbd7ef-a9de-4cc5-8103-969e2c7bea93 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1332 microversion: 2.20 time: 0.094544 Oct 19 13:36:58.415452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1163/2401] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:58 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:58.604624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:58.606448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:58.616061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.617603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.618485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.620682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.621474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.622207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.854574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6097802-0b69-4ef8-86d2-69b057ba2303", "name": "network-vif-unplugged", "status": "completed", "tag": "1432a9c6-8c6c-4dab-b3f2-84ff265ba930"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:58.873700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:58.874456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:58.875128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:58.888912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:58.890180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] Creating event network-vif-unplugged:1432a9c6-8c6c-4dab-b3f2-84ff265ba930 for instance e6097802-0b69-4ef8-86d2-69b057ba2303 on hv-cinder-maste Oct 19 13:36:58.896274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-02b43370-aff1-4048-8a28-fab1dd148b3f req-6114f96c-e3ff-470f-9757-e792cf7ad9a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164436 Oct 19 13:36:58.897063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1164/2402] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:36:58.901378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4370b26f-0b45-4317-99ae-91020b95f6e3 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.300738 Oct 19 13:36:58.902111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1239/2403] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:36:59.116826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:59.117699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:59.125395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.126249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.127099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.127942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.128523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.129264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.132603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6097802-0b69-4ef8-86d2-69b057ba2303", "name": "network-vif-deleted", "tag": "1432a9c6-8c6c-4dab-b3f2-84ff265ba930"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:36:59.143217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.143702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.144327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.147486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:36:59.162178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] Creating event network-vif-deleted:1432a9c6-8c6c-4dab-b3f2-84ff265ba930 for instance e6097802-0b69-4ef8-86d2-69b057ba2303 on hv-cinder-maste Oct 19 13:36:59.167991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-3234427b-f780-4feb-9785-f6014f8b1d8c req-d9d394b3-15b8-457d-98cc-277c9e342fdf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038940 Oct 19 13:36:59.168608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1240/2404] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:36:59.221589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f71530099a11440b9d69f550286d9614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3df7886f27d4ef48cb9031e75a15e46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:59.231022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-54cbae15-1f94-427e-b94e-b726a8693f43 tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 200 len: 1478 microversion: 2.1 time: 0.118850 Oct 19 13:36:59.231710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1165/2405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:59 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 1478 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:36:59.442960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:59.444114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:59.471759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.472281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.472873 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.475511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.476004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.476449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.643439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:59.654062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:59.655517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:36:59.656658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8897295f-d3c7-4e31-be1a-b851729aa326 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.219826 Oct 19 13:36:59.658329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1241/2406] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:36:59 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:36:59.924999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:36:59.925748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:36:59.933204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.933971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.934422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:36:59.935127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:36:59.935682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:36:59.936103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.137133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:00.146188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab1f0412-dcbc-4cee-9595-286016853101 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.225082 Oct 19 13:37:00.146778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1166/2407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:36:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:00.255575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:00.256174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] [instance: e6097802-0b69-4ef8-86d2-69b057ba2303] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:00.263289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:00.263781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:00.264218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.264945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:00.265368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:00.265793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.280403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] HTTP exception thrown: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Request method failure captured: Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 HTTP/1.1 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_grUiWfjHcKRjENAP_RctiCr9kbAUsDzM_Qr_3wt-wOkw5_G71-z-4onc2teEAMBslvdhpHV4pXJTdRP6ZfWkj3xOqYQIV5LYc-J_Pv1yYr7cjxwKc02k2GAIi9BSd6eLY20KJY6b-PWU3AQrVZKHF1s2-Xrfh9GnfzBWkko6dYeoM Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:37:00.282134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3df7886f27d4ef48cb9031e75a15e46", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3df7886f27d4ef48cb9031e75a15e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: c3df7886f27d4ef48cb9031e75a15e46 Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1996766817 Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: f71530099a11440b9d69f550286d9614 Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1996766817-project Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. Oct 19 13:37:00.283912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'e6097802-0b69-4ef8-86d2-69b057ba2303'} Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:37:00.284921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. Oct 19 13:37:00.286852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:37:00.288352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] Returning 404 to user: Instance e6097802-0b69-4ef8-86d2-69b057ba2303 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:37:00.288352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60104b0e-5726-4089-bbb8-7d1b6b1a6b0e tempest-ServerRescueNegativeTestJSON-1996766817 tempest-ServerRescueNegativeTestJSON-1996766817-project] 10.222.0.17 "GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303" status: 404 len: 111 microversion: 2.1 time: 0.032485 Oct 19 13:37:00.288352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1242/2408] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:00 2022] GET /compute/v2.1/servers/e6097802-0b69-4ef8-86d2-69b057ba2303 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:37:00.522671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320026c6-9bba-465d-9022-c32b670f3a9b", "tag": "ba5db0e0-3d72-43e4-b5c4-2942be7db45d"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:00.542673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:00.543491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:00.543931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.556790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] Creating event network-changed:ba5db0e0-3d72-43e4-b5c4-2942be7db45d for instance 320026c6-9bba-465d-9022-c32b670f3a9b on hv-cinder-maste Oct 19 13:37:00.563029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-6dcc1de6-2f04-4d99-99d6-f385360fc67f req-ba65831b-f8ec-466d-b0b0-63d73b80c68d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116600 Oct 19 13:37:00.564088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1167/2409] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:37:00.684333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:00.684940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:00.691571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:00.692254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:00.693009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.693798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:00.694326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:00.694828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:00.911956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:00.921632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:00.923080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:00.924226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3819fd7d-0df6-4f4b-94c7-0e69dd3e0f78 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.244427 Oct 19 13:37:00.924783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1243/2410] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:00 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:01.170754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:01.171393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:01.178667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.179153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.179596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:01.180294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.180745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.181260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:01.330944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:01.340581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4c9cc15e-87ec-4b0e-b022-f596c4c22eaf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174118 Oct 19 13:37:01.341138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1168/2411] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:01.951675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:01.953070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:01.963735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.964219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.964660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:01.970148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:01.970645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:01.971083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:02.242211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:02.253434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:02.257002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:02.258278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-593c1b9f-30aa-4c8f-80ff-36edee1e004a tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.311453 Oct 19 13:37:02.281087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1244/2412] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:01 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:02.363741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:02.364337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:02.371617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:02.372377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:02.373015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:02.373908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:02.374717 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:02.375288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:02.783704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:02.796359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f20fb2a3-49e7-4f8d-9c98-325d50281c19 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.436482 Oct 19 13:37:02.796961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1169/2413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:03.294345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:03.295131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:03.302478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.303645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.303645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.304405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.305121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.305636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.502056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:03.513049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:03.515193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:03.516890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1b153ab7-a9c8-4656-8322-82cbfcaa0bb4 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.226411 Oct 19 13:37:03.517651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1245/2414] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:03 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:03.820100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:03.827321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:03.834910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.835742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.836414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:03.837690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:03.839063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:03.839454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.055844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.065953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d654a205-d106-4e44-b110-9b7565559a9e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.249955 Oct 19 13:37:04.066599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1170/2415] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:04.541750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:04.542381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:04.549092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.549574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.550002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.550999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.551411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.551834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.731024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.739844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.741253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:04.742366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2d3b4a93-8218-4cea-a961-ffe3ee7a2acb tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.204539 Oct 19 13:37:04.742917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1246/2416] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:04 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:04.859610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320026c6-9bba-465d-9022-c32b670f3a9b", "name": "network-vif-plugged", "status": "completed", "tag": "ba5db0e0-3d72-43e4-b5c4-2942be7db45d"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:04.871923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:04.872948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:04.873682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:04.886905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] Creating event network-vif-plugged:ba5db0e0-3d72-43e4-b5c4-2942be7db45d for instance 320026c6-9bba-465d-9022-c32b670f3a9b on hv-cinder-maste Oct 19 13:37:04.892652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-581b2097-7980-44ab-8831-c1011dc6656c req-ac2bb9bf-fe8c-4541-85e0-792dfdce5692 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 Oct 19 13:37:04.893411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1171/2417] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:05.090767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:05.091388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:05.099378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.099864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.100276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.101251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.101698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.102127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.251466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.261138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e463a715-b1d0-48f5-9b15-fc2ad30056cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174781 Oct 19 13:37:05.261839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1247/2418] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:05.768315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:05.769153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:05.775527 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.775994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.776424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.777150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:05.777570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:05.777975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:05.909916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.918722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.920202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:05.921815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f3b27928-8f2f-4b01-8fa8-05d8f4f31094 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1406 microversion: 2.20 time: 0.157610 Oct 19 13:37:05.922380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1172/2419] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:05 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:06.285391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:06.286023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:06.293086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.293575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.294022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.294716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.295181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.295608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.429538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:06.438032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c9b0472b-70a4-40a7-94b3-dbc82bb48eb0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156954 Oct 19 13:37:06.438584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1248/2420] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:06.951269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:06.952095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:06.962128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.962867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.963533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:06.965526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:06.966291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:06.966984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.114233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.123032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.124476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.125677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-336b2d00-fa54-4bfa-8d62-e5750054ee52 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1598 microversion: 2.20 time: 0.181078 Oct 19 13:37:07.126231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1173/2421] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:37:06 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:37:07.150475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:07.150964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:07.157273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.157718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.158151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.158831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.159279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.159918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.241754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9f91a5a3-f617-44a8-a36c-3bdbe57e3102 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095220 Oct 19 13:37:07.242382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1249/2422] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Oct 19 13:37:07 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:37:07.462322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:07.462616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:07.464453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:07.465207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=6 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:07.471598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.472156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.472814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.473545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:07.473993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:07.474412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:07.712416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:07.720854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eea0abe9-e2a2-4536-bf46-8cfa95f66b47 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.263010 Oct 19 13:37:07.721547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1174/2423] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:07 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:08.267340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:08.271843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320026c6-9bba-465d-9022-c32b670f3a9b", "tag": "ba5db0e0-3d72-43e4-b5c4-2942be7db45d"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:37:08.282611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.283121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.283544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.295944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] Creating event network-changed:ba5db0e0-3d72-43e4-b5c4-2942be7db45d for instance 320026c6-9bba-465d-9022-c32b670f3a9b on hv-cinder-maste Oct 19 13:37:08.301741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-de5897ef-5e48-4e63-a254-99b951b2a385 req-71ed5ba4-bc4b-423c-808c-55d327068dd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035428 Oct 19 13:37:08.302369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1250/2424] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:37:08.744438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:08.745352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:08.752512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.753023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.753732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.754434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:08.754840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:08.755454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:08.772245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:08.958420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:08.967394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-df33e1e2-707a-4d06-9713-1c559b253f5d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.227134 Oct 19 13:37:08.967976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1175/2425] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:09.992622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:09.993370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:10.000448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.000963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.001402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.002097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:10.002552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:10.002975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:10.138148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:10.146787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e27c74ad-7c9e-45cf-8ed4-2370069b179f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159229 Oct 19 13:37:10.147365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1251/2426] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:11.170394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:11.171031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:11.177875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.178349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.178777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.179462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:11.179901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:11.180313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:11.313555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:11.322389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0d254fce-9191-4d8b-b0dd-7c8671d5e9cc tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156074 Oct 19 13:37:11.322972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1176/2427] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:12.346368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:12.347185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:12.354202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.354690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.355136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.355849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:12.356287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:12.356713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:12.494885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:12.503465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-900a82db-9c0e-43dd-939a-9d92b9656da6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161139 Oct 19 13:37:12.504257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1252/2428] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:13.527789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:13.528456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:13.535613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.536160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.536594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.537316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:13.537766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:13.538178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:13.894703 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:13.903363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3d186105-ed66-47aa-8e13-f9ca42ea2a82 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.379555 Oct 19 13:37:13.903939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1177/2429] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:13 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:14.926857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:14.927424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:14.934478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.934967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.935406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:14.936094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:14.936546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:14.937000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:15.069828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:15.078611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-119b9d06-03bd-4c54-9cec-e425402e168c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155862 Oct 19 13:37:15.079185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1253/2430] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:16.294781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:16.295385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:16.301670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.302145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.302576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.303226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:16.303662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:16.304064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:16.437407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:16.445739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb24574d-dbdc-41d5-bbb9-4f0c07a6612d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.347425 Oct 19 13:37:16.446338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1178/2431] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:17.469697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:17.470285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:17.472920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:17.478799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.479282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.479701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:17.480393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:17.480837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:17.481280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:17.615911 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:17.624694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4f9d358-aedc-40e0-b5b4-2b37ed1134eb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158889 Oct 19 13:37:17.625275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1254/2432] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:17 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:18.648539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:18.649358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:18.655486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.655963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.656396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.657135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:18.657582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:18.657998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:18.800746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:18.809237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9184de5d-f838-4608-9d6c-5c35e47a15ff tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.164842 Oct 19 13:37:18.809800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1179/2433] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:18 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:19.833175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:19.833811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:19.840495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.841015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.841457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.842151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:19.842639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:19.843070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:19.975243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:19.983932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-86202a24-329f-47f2-8f7f-9c89455b1e21 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154760 Oct 19 13:37:19.984510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1255/2434] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:19 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:21.009270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:21.009878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:21.017123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.017685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.018142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.018909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:21.019351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:21.019767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:21.170959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:21.179930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e3e6c544-7285-4818-b02d-41fc60a35b54 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.174809 Oct 19 13:37:21.180500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1180/2435] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:21 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:22.203994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:22.204624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:22.211850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:22.212334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:22.212763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:22.213487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:22.213937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:22.214352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:22.351212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:22.360012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0b00d278-2144-47c1-b9a0-bfd8faaaac34 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159980 Oct 19 13:37:22.360595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1256/2436] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:22 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:23.384825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:23.385437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:23.387855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:23.394095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.394645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.395113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:23.395848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:23.396305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:23.396715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:23.539910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:23.549146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-805daa9f-1c79-4ed0-a141-c8749cd151cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.168260 Oct 19 13:37:23.549726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1181/2437] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:23 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:24.572281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:24.573031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:24.579882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:24.580365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:24.580820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:24.581724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:24.582184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:24.582607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:24.712630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:24.721442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3aded223-1ea6-4ce1-8c7d-9e3dcb18b03d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153330 Oct 19 13:37:24.722077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1257/2438] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:24 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:25.745720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:25.746357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:25.753288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.753772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.754204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.754893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:25.755340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:25.755756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:25.887782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:25.896350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1bbee506-b92d-4087-8920-9d52765f2e31 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155122 Oct 19 13:37:25.896917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1182/2439] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:25 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:26.920424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:26.921051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:26.928369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.929969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.929969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:26.930256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:26.930577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:26.930997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:27.068100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:27.076968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-726cf29f-1d4d-4844-a063-9d09b651f198 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160563 Oct 19 13:37:27.077537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1258/2440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:26 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:28.100942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:28.101582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:28.108602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:28.109125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:28.109552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:28.110237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:28.110684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:28.111099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:28.244590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:28.253099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f66e202c-c735-4739-bd98-11210f054d20 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156233 Oct 19 13:37:28.253801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1183/2441] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:28 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:29.277088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:29.277728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:29.284525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.285048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.285489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:29.286176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:29.286628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:29.287049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:29.289750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=100 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:29.422266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:29.431329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3689b527-b743-4f95-849d-959501ae5eac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158274 Oct 19 13:37:29.431906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1259/2442] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:29 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:30.455272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:30.455866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:30.462976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:30.463462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:30.463895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:30.464585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:30.465077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:30.465501 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:30.603097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:30.611599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-476eb65d-173c-4242-b473-598040419bdd tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160286 Oct 19 13:37:30.612217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1184/2443] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:30 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:31.637748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:31.638403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:31.646187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.646543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.647037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.647772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:31.648219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:31.648635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:31.783821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:31.792807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a5fedcd4-71d0-4d2b-bdd4-902557f05ae1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160953 Oct 19 13:37:31.793426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1260/2444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:31 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:32.815795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:32.816404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:32.823357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.823831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.824253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.824991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:32.825426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:32.825833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:32.956075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:32.964678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d19ca16c-b04d-4b56-8251-d6a5cb489061 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152730 Oct 19 13:37:32.965281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1185/2445] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:32 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:33.988399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:33.989048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:33.996715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.997234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.997670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:33.998377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:33.998830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:33.999285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:34.141391 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:34.150152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fde3c2da-b94c-4cab-b79e-a4664489964f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.165645 Oct 19 13:37:34.150736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1261/2446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:33 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:35.174540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:35.175171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:35.182171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.182653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.183081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.183769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:35.184214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:35.184631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:35.318860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:35.327607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb55b139-82cb-4b0a-85de-f380082de9a1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157113 Oct 19 13:37:35.328146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1186/2447] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:35 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:36.353900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:36.354537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:36.361500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.361981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.362438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.363129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:36.363575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:36.363991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:36.497568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:36.506796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-89e9b34c-4d76-495e-8f17-c39b967eddd2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156802 Oct 19 13:37:36.507379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1262/2448] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:36 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:37.530444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:37.531124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:37.537980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.538458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.538879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.539568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:37.539975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:37.540409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:37.676634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:37.685759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8ce7cd30-38c9-4778-bf97-7a59dd4a5cb5 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159192 Oct 19 13:37:37.686337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1187/2449] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:37 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:38.710299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:38.710906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:38.717898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.718382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.718817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.719530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:38.719964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:38.720387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:38.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:38.868713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5527e53c-868d-4ef4-84ac-a63da688675a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.162827 Oct 19 13:37:38.869340 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1263/2450] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:38 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:39.892997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:39.893637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:39.900520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.901045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.901474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.902192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:39.902608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:39.903018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:39.905640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=76 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:40.037303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:40.050462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c8ba3f5e-322a-4a60-87d4-c39c52cf2c04 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161347 Oct 19 13:37:40.051388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1188/2451] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:39 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:41.080883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:41.081512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:41.088446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.088986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.089382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.090070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:41.090518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:41.090933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:41.223561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:41.232245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d0508684-7d00-43f9-8f1a-9bff5e68e85c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155376 Oct 19 13:37:41.232813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1264/2452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:41 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:42.258223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:42.258863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:42.265861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.266340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.266767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.267454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:42.267899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:42.268315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:42.406123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:42.415013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-09d77776-c94a-4e81-897b-4df9ea8f3e39 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160941 Oct 19 13:37:42.415586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1189/2453] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:42 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:43.439234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:43.439892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:43.446942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.447419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.447849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.448536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:43.449015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:43.449433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:43.580127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:43.588939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9ec5b383-0d9b-4104-9d79-f72f5813d9f6 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.153830 Oct 19 13:37:43.589538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1265/2454] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:43 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:44.441634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:44.442265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:44.449655 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.450140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.450572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.451265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.451714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.452130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.477755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3ab4ed68-e81c-476c-a187-4651bf029fd6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b/ips" status: 200 len: 152 microversion: 2.20 time: 0.040015 Oct 19 13:37:44.478314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1190/2455] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Oct 19 13:37:44 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 13:37:44.612644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:44.613233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:44.620408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.620893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.621359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.622046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:44.622494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:44.623116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:44.757862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:44.766650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9d005951-0988-4fcc-8a76-df0193f9a5a7 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158125 Oct 19 13:37:44.767198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1266/2456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:44 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:45.791196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:45.791856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:45.798766 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.799245 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.799675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.800360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:45.800809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:45.801255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:45.936306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:45.945075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9034ecaa-41b4-43ef-a3cb-879c99bd4d43 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157773 Oct 19 13:37:45.945640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1191/2457] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:45 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:46.969374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:46.969956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:46.978221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.978711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.979149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:46.979843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:46.980290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:46.980708 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:47.116856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:47.125879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5c1d99b5-1bdd-4229-be01-2d3b2c007489 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160622 Oct 19 13:37:47.126459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1267/2458] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:46 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:48.153124 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:48.153769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:48.160313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.160789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.161464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.162623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:48.163073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:48.163493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:48.298156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:48.307498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e3e6756e-0695-4747-9b78-fdee88b4112c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158319 Oct 19 13:37:48.308044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1192/2459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:48 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:49.331939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:49.332460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:49.335180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:49.340607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.341115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.341546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.342239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:49.342684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:49.343101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:49.479515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:49.488102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-410f5a5c-4bc6-404f-a3ac-e3456de61a1b tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160170 Oct 19 13:37:49.488674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1268/2460] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:49 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:50.511932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:50.512577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:50.519378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.519850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.520264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.520985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:50.521411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:50.521830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:50.653392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:50.662248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-87d17bdc-234a-43f8-a734-05ab23f04f1f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154252 Oct 19 13:37:50.662790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1193/2461] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:50 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:51.686356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:51.686959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:51.694151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.694705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.695139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.695837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:51.696283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:51.696698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:51.825901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:51.834589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-58ef65c4-66d1-4758-ad95-cce765a253bb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152573 Oct 19 13:37:51.835402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1269/2462] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:51 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:52.859188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:52.859801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:52.867208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.868033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.868463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:52.869209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:52.869658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:52.870075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:53.007337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:53.016134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a27e0f4a-7cbf-44fd-b73c-c50f1d73f7ac tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160976 Oct 19 13:37:53.016716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1194/2463] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:52 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:54.040477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:54.041171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:54.048813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:54.049341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:54.049776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.050472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:54.050920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:54.051352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:54.190106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:54.199390 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-daa78a2d-7e63-4820-a031-f9b079e0f96a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.163617 Oct 19 13:37:54.199977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1270/2464] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:54 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:55.222826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:55.223525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:55.226014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:37:55.231730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.232205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.232626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.233338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:55.233777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:55.234175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:55.366866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:55.376090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-979a3d83-93f6-4e00-89cd-b3e067bea828 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.157125 Oct 19 13:37:55.376677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1195/2465] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:55 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:56.401834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:56.402464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:56.409679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:56.410163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:56.410600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.412011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:56.412479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:56.412897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:56.544194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:56.552774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e9ff671d-9278-4e9d-8885-f9499585296d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154925 Oct 19 13:37:56.553388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1271/2466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:56 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:57.576260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:57.576820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:57.584014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.584488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.585035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.585719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:57.586163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:57.586575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:57.723061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:57.732100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8936baa4-ef78-419d-adde-0d4898a0726e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159852 Oct 19 13:37:57.732677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1196/2467] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:57 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:58.762430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:58.763068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:58.769993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.770573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.771101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.771854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:58.772304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:58.772725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:58.901939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:37:58.910672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2bb5ff01-933c-4600-bce8-405cc075a30d tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152182 Oct 19 13:37:58.911612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1272/2468] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:58 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:37:59.935303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:37:59.935891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:37:59.942935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.943419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.943851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:37:59.944540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:37:59.945020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:37:59.945442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:00.074851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:00.083271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c78e3696-1cb3-403c-97c0-0aebe907b20e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.152050 Oct 19 13:38:00.083832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1197/2469] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:37:59 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:01.106817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:01.107471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:01.114305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.114831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.115325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.115997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:01.116472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:01.116906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:01.119824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:01.253645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:01.262336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0e678d92-2fab-4d40-b93b-62d530cf46e0 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.159547 Oct 19 13:38:01.262894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1273/2470] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:01 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:02.286332 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:02.286986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:02.294257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:02.294734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:02.295183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:02.295907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:02.296353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:02.296770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:02.429235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:02.437892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ff0db7fe-e8b4-4aa0-a9f0-9a915d67fc3e tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155538 Oct 19 13:38:02.438472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1198/2471] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:02 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:03.461397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:03.462214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:03.469143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:03.469634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:03.470062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:03.470745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:03.471191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:03.471618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:03.603528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:03.612257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-311eb0d9-8a1f-4619-98e2-11b09db74cbf tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.155035 Oct 19 13:38:03.612875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1274/2472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:03 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:04.636479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:04.637080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:04.644154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.644630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.645177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.646453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:04.646906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:04.647322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:04.784795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:04.793709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7787d9d3-500c-434c-b3d1-2a4840d11a53 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161258 Oct 19 13:38:04.794286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1199/2473] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:04 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:05.818001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:05.818605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:05.826055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.826545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.826987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.827690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:05.828149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:05.828574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:05.966234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:05.975192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d33f2e3-31bc-45b7-82d9-ae2d5fbb18f2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161359 Oct 19 13:38:05.975800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1275/2474] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:05 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:06.999884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:07.000544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:07.007930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.008416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.008844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.009569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:07.010015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:07.010431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:07.141662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:07.150659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c9792328-15d8-4312-ad6c-1679fea6e727 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154791 Oct 19 13:38:07.151233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1200/2475] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:06 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:08.174397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:08.175073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:08.182118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.182606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.183042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.183741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:08.184197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:08.184619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:08.318186 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:08.326742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a6ee1ffa-54a8-4485-906b-a3a22a8f2290 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156249 Oct 19 13:38:08.327296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1276/2476] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:08 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:09.351396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:09.351993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:09.358949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:09.359430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:09.359858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:09.360552 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:09.361026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:09.361447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:09.497864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:09.506880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4311a8be-9d87-4fd5-98d3-80fb9a3a974c tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.160089 Oct 19 13:38:09.507477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1201/2477] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:09 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:10.531107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:10.531739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:10.539113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.539600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.540042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.540744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:10.541253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:10.541685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:10.673238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:10.682170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4d04c978-11ca-4dab-837e-f3f4d70438d2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154976 Oct 19 13:38:10.682756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1277/2478] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:10 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:11.705678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:11.706352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:11.714366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.714843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.715273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.715960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:11.716406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:11.716820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:11.719459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=82 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:11.851312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:11.860278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-036c8fbd-b796-4504-8b53-f90e904f152f tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158511 Oct 19 13:38:11.861300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1202/2479] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:11 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:12.890089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:12.890723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:12.897789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.898271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.898702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:12.899373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:12.899872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:12.900287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:13.035707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:13.045031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4b5406f-9b1c-4f26-bfe5-04fce435696a tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.158788 Oct 19 13:38:13.045689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1278/2480] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:12 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:14.069444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:14.070084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:14.077009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.077494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.077922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.078616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:14.079052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:14.079472 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:14.211274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:14.219759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a7d28cf6-bb82-4cb7-877f-275849b39ff1 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.154831 Oct 19 13:38:14.220343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1203/2481] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:14 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:15.244478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:15.245190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:15.252092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.252574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.253053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:15.253749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:15.254202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:15.254901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:15.387877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:15.397056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b71bfe5-b42b-4d90-805f-8b175e734964 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.156838 Oct 19 13:38:15.397630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1279/2482] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:15 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:16.420691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:16.421373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] [instance: e1de460a-d49c-4426-b831-aea60f28e9aa] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:16.429433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:16.429937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:16.430364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:16.431187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:16.431637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:16.432126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:16.569929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3b0b74c4c894c4d84c3a014a33a786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16aafb1b5ea4b0b911c62d0acadbc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:16.578622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c8d35c5-cf83-4917-8b40-5a57a5d222e2 tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa" status: 200 len: 1600 microversion: 2.1 time: 0.161873 Oct 19 13:38:16.579203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1204/2483] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:16 2022] GET /compute/v2.1/servers/e1de460a-d49c-4426-b831-aea60f28e9aa => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:16.601106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c10ba1ca-d65e-42db-84cf-f1afd3bde6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] Calling method '.version_select at 0x7ff4fca3a310>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:16.622838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c10ba1ca-d65e-42db-84cf-f1afd3bde6cb tempest-TestMinimumBasicScenario-10071495 tempest-TestMinimumBasicScenario-10071495-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-135362570" status: 202 len: 0 microversion: 2.1 time: 0.025640 Oct 19 13:38:16.623415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1280/2484] 10.222.0.17 () {58 vars in 1269 bytes} [Wed Oct 19 13:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-135362570 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:38:17.566920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:17.567480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:17.574740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.575400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.575843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.576738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.577233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.577838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.606978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:38:17.694915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d9697e8-862d-4fa1-8dce-1f97afbf9290 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 204 len: 0 microversion: 2.1 time: 0.132448 Oct 19 13:38:17.698877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1205/2485] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:38:17 2022] DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:38:17.705318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:17.705907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:17.714531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.715012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.715444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.716138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:17.716584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:17.717032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:17.854258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:17.862881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-85063544-8a07-45b5-adf9-a22ce97a2388 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.162759 Oct 19 13:38:17.863421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1281/2486] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:18.888559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:18.890443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:18.898432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:18.898927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:18.899364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:18.901373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:18.902052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:18.902481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:19.388302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:19.397410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-793d3a74-5529-4283-80b6-0579669afd45 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.514179 Oct 19 13:38:19.398006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1206/2487] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:20.421817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:20.422448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:20.424543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:20.437284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:20.437731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:20.438176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:20.438976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:20.439456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:20.439885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:20.589150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:20.598214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a23df825-e009-4ac4-9f08-c787dd776653 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.180574 Oct 19 13:38:20.598957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1282/2488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:21.623691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:21.624280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:21.631480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:21.631951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:21.632420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:21.633133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:21.633579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:21.633994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:21.787767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:21.796762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fecbe81a-0d33-4963-8239-cedda65da819 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.177135 Oct 19 13:38:21.797413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1207/2489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:22.821635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:22.822369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:22.829007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:22.829486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:22.829921 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:22.830613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:22.831072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:22.831505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:22.964146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:22.972652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-004b6f18-cd65-420d-ad45-2dc9d5fc011c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.155215 Oct 19 13:38:22.973778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1283/2490] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:23.996638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:23.997303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:24.004324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:24.004807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:24.005273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:24.005961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:24.006412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:24.006830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:24.141661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:24.150322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3a5b8bc0-a30b-4026-9e91-43b6ec039330 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.157588 Oct 19 13:38:24.150877 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1208/2491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:25.176114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:25.177116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:25.184225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:25.184705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:25.185269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:25.185967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:25.186427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:25.186849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:25.328305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:25.337080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d0b0b92a-e07f-445b-81c4-3cd1dc731df7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166843 Oct 19 13:38:25.337831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1284/2492] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:26.360150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:26.360775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:26.363246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:26.369423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:26.369907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:26.370340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:26.371029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:26.371464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:26.371866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:26.510195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:26.521819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1ebdfd84-04f7-4a00-8d21-3fdeba62f874 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.165294 Oct 19 13:38:26.522646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1209/2493] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:27.546066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:27.546733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:27.553835 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:27.554320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:27.554748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:27.555415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:27.555893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:27.556311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:27.694374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:27.702990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0a435a44-5ea5-4063-9d65-842927dffd9b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.160867 Oct 19 13:38:27.703564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1285/2494] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:28.728760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:28.729353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:28.736272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:28.736750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:28.737236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:28.737922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:28.738368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:28.739077 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:28.871737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:28.880837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eed1430b-bdf3-4455-b089-edb06d2d855a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.156042 Oct 19 13:38:28.881447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1210/2495] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:29.904105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:29.904697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:29.911798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:29.912288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:29.912726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:29.913466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:29.913925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:29.914387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:30.054267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:30.062970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-40ef098f-c56a-4378-9529-ec7c90439499 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.162990 Oct 19 13:38:30.063540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1286/2496] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:31.087226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:31.087822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:31.094804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.095289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.095722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.096414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:31.096890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:31.097329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:31.237913 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:31.250220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4479fc26-a179-4fda-9b94-b50f6fb26514 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.167198 Oct 19 13:38:31.250637 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1211/2497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:32.274342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:32.275004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:32.282030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:32.282513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:32.282942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:32.283636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:32.284079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:32.284496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:32.287607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:32.415013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:32.423476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a93c0a01-af39-47a1-b595-2cf56dccf322 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.153231 Oct 19 13:38:32.424040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1287/2498] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:33.446440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:33.447101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:33.454092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:33.454569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:33.454981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:33.455657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:33.456095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:33.456512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:33.587135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:33.595546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5feb6d48-c846-4af2-a0d1-72e38c816b34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.153208 Oct 19 13:38:33.596114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1212/2499] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:34.619803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:34.620415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:34.627284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:34.627763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:34.628187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:34.629004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:34.629548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:34.629951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:34.781650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:34.793576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-03c24376-be53-4ed1-94dc-1454d2f6cdea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.177848 Oct 19 13:38:34.794161 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1288/2500] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:35.824057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:35.824720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:35.831617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:35.832095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:35.833208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:35.833927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:35.834354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:35.834770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:35.969651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:35.978323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2a9fcce7-e3ad-45b8-9474-16fc56210ecc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.158396 Oct 19 13:38:35.978902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1213/2501] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:37.004462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:37.005168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:37.013421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:37.014091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:37.014808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:37.015542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:37.015542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:37.015996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:37.161563 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:37.170564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a46d787-8252-4d91-95d4-95b473121be9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171451 Oct 19 13:38:37.171119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1289/2502] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:38.197424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:38.198068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:38.205147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:38.205632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:38.206061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:38.206754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:38.207224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:38.208266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:38.349592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:38.358387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-737524c2-77f4-4e73-a85a-fc472d3b9d23 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166629 Oct 19 13:38:38.358954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1214/2503] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:39.381463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:39.382098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:39.389101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:39.389580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:39.390012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:39.390693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:39.391138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:39.391555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:39.534618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:39.543434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f47a6b5e-baac-4b78-aaae-d80284c2884b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.165972 Oct 19 13:38:39.544010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1290/2504] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:40.567837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:40.568419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:40.575312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:40.575792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:40.576222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:40.576923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:40.577401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:40.577819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:40.716458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:40.725274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e391bb33-dbfa-4178-9ca1-45cbdf0aadca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.161858 Oct 19 13:38:40.726174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1215/2505] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:41.750605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:41.751298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:41.758251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:41.758786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:41.759249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:41.759950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:41.760402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:41.760830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:41.904008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:41.917400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-efe9b872-fef1-41dd-bc82-34929685ef6e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.170727 Oct 19 13:38:41.918283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1291/2506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:42.946634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:42.947661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:42.955053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:42.955546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:42.955961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:42.956652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:42.957231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:42.957643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:42.960530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:43.108621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:43.123026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e50cb87-0c73-4871-953a-342ee76626b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.182152 Oct 19 13:38:43.124115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1216/2507] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:44.154788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:44.155791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:44.166847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:44.167651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:44.168370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:44.169538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:44.170308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:44.171025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:44.315752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:44.324754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ae1bd1b-711f-40ef-ab46-49b3b9c618a4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.176772 Oct 19 13:38:44.325362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1292/2508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:45.348882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:45.349515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:45.356172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:45.356664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:45.357127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:45.357820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:45.358263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:45.358677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:45.500956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:45.510317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e8d3e4aa-8eda-4005-82ff-fb838b19c14a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166008 Oct 19 13:38:45.510894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1217/2509] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:46.534250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:46.534885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:46.542025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:46.542515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:46.542946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:46.543642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:46.544096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:46.544517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:46.700180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:46.709452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-731d2a81-6d8a-421c-8aa7-08c631bdac93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.179116 Oct 19 13:38:46.710131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1293/2510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:47.734989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:47.735596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:47.742580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.743053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.743476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.744160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:47.744596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:47.745171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:47.891181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:47.900085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-befdd056-aaad-46e7-a935-f4e763edfc58 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.169823 Oct 19 13:38:47.900647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1218/2511] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:48.923485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:48.924108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:48.933843 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:48.934331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:48.934878 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:48.935646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:48.936093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:48.936551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:49.068254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:49.076695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-730b668e-a787-4da0-ab41-bd82a5a5afbd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.157175 Oct 19 13:38:49.077325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1294/2512] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:50.102048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:50.103010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:50.112668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:50.113692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:50.114445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:50.115801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:50.116795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:50.117352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:50.265252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:50.276050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62563ffe-4e21-4266-ba0f-edb08e709f63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.179480 Oct 19 13:38:50.276662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1219/2513] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:51.300096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:51.300741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:51.302674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=26 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:51.308564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:51.309081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:51.309515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:51.310202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:51.310648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:51.311065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:51.457628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:51.467156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5600ea4c-e1b4-4b62-ad64-a669dd76f379 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171163 Oct 19 13:38:51.467735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1295/2514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:52.499482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:52.500106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:52.507201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:52.507679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:52.508107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:52.508793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:52.509273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:52.509693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:52.652033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:52.660469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5e8a0173-5f26-4aa0-8d7b-3e2d411579aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.164943 Oct 19 13:38:52.661049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1220/2515] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:53.685137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:53.685783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:53.692260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:53.692741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:53.693201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:53.693942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:53.694386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:53.694806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:53.838238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:53.846851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39f4421f-2a9f-46bc-a381-b43434b1c5dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.165793 Oct 19 13:38:53.847446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1296/2516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:54.874870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:54.875809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:54.884801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:54.885305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:54.885728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:54.886445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:54.886855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:54.887308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:55.032818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:55.041628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-02210326-dac4-4af6-bd2b-df285ff0c108 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.173064 Oct 19 13:38:55.042205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1221/2517] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:56.064376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:56.065037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:56.072624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:56.073169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:56.073636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:56.074417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:56.074862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:56.075278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:56.210964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:56.219534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-468e599b-7218-4d9e-8a52-d75eebc7fb9a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.159131 Oct 19 13:38:56.220074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1297/2518] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:57.247323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:57.248350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:57.252085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=26 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:38:57.259775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:57.260258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:57.260689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:57.261409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:57.261858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:57.262273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:57.398556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:57.407313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5c812b66-1b93-4a70-af67-20025738b727 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166887 Oct 19 13:38:57.407888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1222/2519] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:58.431253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:58.431834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:58.438793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:58.439271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:58.439697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:58.440382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:58.440827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:58.441277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:58.578736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:58.587430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1f1560fd-67e3-4dcb-8920-d2d2b6722afb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.160286 Oct 19 13:38:58.587972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1298/2520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:38:59.612581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:38:59.613381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:38:59.621721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:59.622199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:59.622625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:59.623306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:38:59.623743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:38:59.624152 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:38:59.757449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:38:59.770284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a7ea686a-607d-441a-bb9e-840cac4a98ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.162849 Oct 19 13:38:59.771111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1223/2521] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:38:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:00.796308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:00.796947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:00.803957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:00.804467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:00.804975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:00.805654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:00.806099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:00.806514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:00.946699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:00.955338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2493d1f2-2f52-4b51-87ae-8cf72b405a05 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.162863 Oct 19 13:39:00.955834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1299/2522] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:01.981050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:01.981810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:01.990477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:01.991439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:01.991978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:01.992979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:01.993437 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:01.994007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:02.142965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:02.151975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c544dc7a-4457-48fb-956a-0b199cde3aeb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.175886 Oct 19 13:39:02.152536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1224/2523] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:03.177622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:03.178405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:03.187700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:03.188370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:03.188939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:03.189880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:03.190485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:03.191051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:03.194519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:03.330918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:03.341119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eec5ab6a-286a-4ba8-bee0-3354aa232413 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168758 Oct 19 13:39:03.341691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1300/2524] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:04.363908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:04.364973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:04.376686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:04.377304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:04.377733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:04.378426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:04.378868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:04.379278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:04.525279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:04.536971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9cb7ed9a-ced6-4d2e-a709-baadbde77486 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.176926 Oct 19 13:39:04.537541 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1225/2525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:05.561470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:05.562131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:05.570348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:05.570888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:05.571432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:05.572728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:05.573336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:05.573866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:05.718070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:05.726895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cb0aa5a0-c73d-4371-a7e5-c4d6f6b7f1c3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.170496 Oct 19 13:39:05.727431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1301/2526] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:06.751681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:06.752263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:06.759422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:06.759938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:06.760392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:06.761116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:06.761560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:06.761973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:06.896351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:06.905025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d1ea2ed0-ab32-425b-973b-5d61f1b69eba tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.157266 Oct 19 13:39:06.905589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1226/2527] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:07.928847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:07.929580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:07.936693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:07.937221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:07.937664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:07.938348 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:07.938804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:07.939225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:08.085505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:08.098145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e99a2f8d-41e0-42bf-bc5b-48e7aaa558f7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.172994 Oct 19 13:39:08.098999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1302/2528] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:09.133211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:09.133968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:09.141151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:09.141632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:09.142061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:09.142738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:09.143193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:09.143609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:09.282073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:09.292066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab75367f-000f-4591-85ed-e3313324c724 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.165124 Oct 19 13:39:09.292728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1227/2529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:10.319246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:10.320058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:10.330692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:10.331473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:10.332175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:10.333330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:10.334077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:10.334769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:10.481887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:10.490998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b996ef0-fd7b-4c0e-ae46-d41bc233f264 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.176644 Oct 19 13:39:10.491588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1303/2530] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:11.516582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:11.517377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:11.526118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:11.526605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:11.527034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:11.527718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:11.528166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:11.528609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:11.667687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:11.680149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bc7d9227-7c29-4f7d-a6f2-e02bcc087372 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168222 Oct 19 13:39:11.680891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1228/2531] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:12.707740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:12.708528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:12.719247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:12.720026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:12.720725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:12.721917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:12.722649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:12.723333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:12.860837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:12.870289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2e33f878-94c7-4039-b606-da220dad02fc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.169211 Oct 19 13:39:12.870836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1304/2532] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:13.896316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:13.897107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:13.905149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:13.905631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:13.906059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:13.906770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:13.907216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:13.907619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:13.910228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=78 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:14.057630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:14.066219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0373793d-5964-4256-837c-2fe6c08a18b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.175610 Oct 19 13:39:14.066784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1229/2533] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:15.098858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:15.099658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:15.107833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:15.108325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:15.108762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:15.109502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:15.109960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:15.110388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:15.492129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:15.501693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fb6e7541-3cf7-44c8-97a6-b06af2118edb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.408055 Oct 19 13:39:15.502262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1305/2534] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:16.527931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:16.528606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:16.536658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:16.537221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:16.537700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:16.538453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:16.538948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:16.539781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:16.677989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:16.691026 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6a0bc30b-88dd-4b47-91d3-33cd904efb63 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168881 Oct 19 13:39:16.691812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1230/2535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:17.720104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:17.720732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:17.728512 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:17.729092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:17.729634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:17.730396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:17.730896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:17.731367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:17.874350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:17.887002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-084f2248-ac8c-4a77-93fa-b9079fe2812d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171682 Oct 19 13:39:17.887796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1306/2536] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:18.914163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:18.914784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:18.924584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:18.925244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:18.925832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:18.926823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:18.927462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:18.927957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:19.068457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:19.076987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2421c720-f264-436a-a97e-60195db304d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.169034 Oct 19 13:39:19.077547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1231/2537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:20.104993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:20.105771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:20.113822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:20.114305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:20.114740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:20.115774 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:20.116225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:20.116650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:20.259516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:20.268486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e0ea1d80-f190-416d-a6c3-374a760a8327 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.170223 Oct 19 13:39:20.269106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1307/2538] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:21.300842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:21.301505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:21.312813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:21.312813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:21.313356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:21.315024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:21.315024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:21.315024 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:21.454417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:21.467487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0fb3a132-40b4-4ead-ad25-815d914654ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171821 Oct 19 13:39:21.468236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1232/2539] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:22.491980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:22.492616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:22.494963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=26 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:22.500581 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:22.501166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:22.501613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:22.502297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:22.502750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:22.503170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:22.665156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:22.675890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9838017-35d8-48df-a194-6bd7b816b4e2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.188001 Oct 19 13:39:22.676617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1308/2540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:23.699921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:23.700505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:23.707646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:23.708116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:23.708540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:23.709248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:23.709670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:23.710092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:23.851454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:23.860786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-de019fae-df63-449e-802d-4273607189b1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.164849 Oct 19 13:39:23.861394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1233/2541] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:24.890465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:24.891278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:24.900805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:24.901679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:24.902411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:24.903540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:24.904300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:24.905049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:25.051401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:25.062236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ff3d106d-ec7c-47ab-ba24-2aee30b20d46 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.178237 Oct 19 13:39:25.063143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1309/2542] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:26.087001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:26.087680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:26.095767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:26.096308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:26.096791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:26.097603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:26.098102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:26.098571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:26.239513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:26.250170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a8c53c17-1c08-4786-b565-92d52431db91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.167621 Oct 19 13:39:26.251051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1234/2543] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:27.281546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:27.283312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:27.290050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:27.290574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:27.291006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:27.291710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:27.292159 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:27.292675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:27.485766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:27.495083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bb79ac64-5bc3-49ef-9f58-0046bd640448 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.218508 Oct 19 13:39:27.495658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1310/2544] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:28.521447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:28.522113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:28.524990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=26 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:28.531408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:28.531969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:28.532473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:28.533305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:28.533827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:28.534320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:28.689820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:28.702514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3f931900-696a-4969-8a10-c44814956c12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.185886 Oct 19 13:39:28.703383 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1235/2545] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:29.735193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:29.735986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:29.738645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:39:29.738799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:39:29.745541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:29.746024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:29.746466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:29.747260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:29.747808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:29.748463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:29.890018 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:29.899827 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c75e110a-163c-4752-b667-4d8998b4afa0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.170774 Oct 19 13:39:29.900354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1311/2546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:30.925911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:30.926726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:30.935843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:30.936479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:30.937100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:30.938056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:30.938650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:30.939445 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:31.085652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:31.094111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-88d9df2b-ccf6-47a5-b810-aee4115b1825 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.173793 Oct 19 13:39:31.094665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1236/2547] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:32.119979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:32.120733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:32.129745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:32.130471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:32.131441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:32.132414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:32.133282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:32.134088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:32.289291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:32.298252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-747619b8-26fe-4dbf-af80-3a751a5bd50b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.183610 Oct 19 13:39:32.298821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1312/2548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:33.324335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:33.325321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:33.328932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:39:33.329082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:39:33.338845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:33.339352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:33.340079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:33.341149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:33.341850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:33.342441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:33.500629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:33.509849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-13cac31c-25ed-4889-9e6c-cc270e77284d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.191730 Oct 19 13:39:33.510426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1237/2549] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:34.538232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:34.539167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:34.550190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:34.550668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:34.551106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:34.551791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:34.552243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:34.552661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:34.555264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:34.699802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:34.713836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-66cb0d3c-7eaf-494a-8429-12f830273732 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.182479 Oct 19 13:39:34.714602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1313/2550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:35.741394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:35.741959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:35.748826 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:35.749374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:35.749810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:35.750524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:35.750951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:35.751373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:35.915040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:35.927071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ce792af-19bc-4af6-a814-5edf82699754 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.190402 Oct 19 13:39:35.927636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1238/2551] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:36.954274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:36.955054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:36.966460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:36.967239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:36.967809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:36.968942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:36.969597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:36.970156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:37.114403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:37.127260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75ceb24c-d795-4c95-97c7-2b0a6be93894 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.179211 Oct 19 13:39:37.127901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1314/2552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:38.153353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:38.154186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:38.163382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:38.164015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:38.164582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:38.165515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:38.166096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:38.166650 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:38.319464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:38.332546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b31eafe4-8fae-4501-9170-154ad0711458 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.184041 Oct 19 13:39:38.333443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1239/2553] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:39.361373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:39.361971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:39.369427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:39.369944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:39.370442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:39.371216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:39.371844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:39.372271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:39.517164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:39.526234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c8ec6bf0-d79f-48a7-b668-89500dafb641 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168818 Oct 19 13:39:39.526792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1315/2554] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:40.554098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:40.554997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:40.564682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:40.565435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:40.565793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:40.566467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:40.566906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:40.567310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:40.710543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:40.719231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a333c8ff-65d1-40f5-a216-59f228c15d5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171192 Oct 19 13:39:40.722946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1240/2555] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:41.745705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:41.746480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:41.755056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:41.755694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:41.756167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:41.757064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:41.757624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:41.758148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:41.904359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:41.916894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8e004aca-514c-46c7-9553-690f67d25904 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.175934 Oct 19 13:39:41.917719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1316/2556] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:42.945021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:42.945692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:42.952550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:42.953068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:42.953502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:42.954190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:42.954644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:42.955049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:43.099202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:43.107601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-615f511c-2795-470e-b9f4-a5b4f13e84aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166987 Oct 19 13:39:43.108460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1241/2557] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:44.136061 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:44.137026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:44.147467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:44.147958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:44.148373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:44.149079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:44.149523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:44.149937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:44.296396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:44.309166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-69c6a492-a39c-40b9-9946-d38d12bd37ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.179346 Oct 19 13:39:44.309746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1317/2558] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:45.337149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:45.337677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:45.347057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:45.347673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:45.348213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:45.349271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:45.349803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:45.350223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:45.352799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=78 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:45.491246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:45.499757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-10fd6c68-1af0-4db5-979c-042763926ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.169480 Oct 19 13:39:45.500308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1242/2559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:46.523834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:46.524487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:46.531375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.531859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.532285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.533014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:46.533463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:46.533879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:46.666147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:46.679021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-94cc56ef-46e9-413c-a5ff-02e8d12579cc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.158948 Oct 19 13:39:46.679818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1318/2560] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:47.710674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:47.711255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:47.717732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.718223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.718660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.719346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:47.719829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:47.720246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:47.860914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:47.879657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9856fa15-1f50-4d6f-a93b-993337463ae5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.174437 Oct 19 13:39:47.880576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1243/2561] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:48.907586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:48.908167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:48.915688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:48.916172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:48.916585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:48.917335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:48.917780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:48.918197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:49.053092 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:49.061973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-42fd3aa9-5419-4721-8043-00c7fa208537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.160691 Oct 19 13:39:49.062768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1319/2562] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:50.091260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:50.092319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:50.103388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:50.104178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:50.104945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:50.106076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:50.106820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:50.107512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:50.252909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:50.262694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-40fa13d0-d649-464c-b5fa-9c6548128c93 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.177912 Oct 19 13:39:50.263261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1244/2563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:39:51.288268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:51.288904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:51.296194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.296675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.297136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:51.297825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:51.298273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:51.298692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:51.436685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:51.449829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-de446549-5506-4af6-9f3c-9ed2de6f36fb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166182 Oct 19 13:39:51.450642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1320/2564] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:52.476749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:52.477385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:52.479821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:39:52.479992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:39:52.487594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:52.488104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:52.488630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:52.489354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:52.490534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:52.490974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:52.642537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:52.655214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-52f1ba63-4039-44d0-a2fc-f628ba98e25a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.183277 Oct 19 13:39:52.656158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1245/2565] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:53.684075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:53.684714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:53.687796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=26 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:53.695655 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.696281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.696837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.697794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:53.698386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:53.698944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:53.841863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:53.855150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-93a6b641-cef8-4887-af05-d9ae12107a91 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.176305 Oct 19 13:39:53.856046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1321/2566] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:54.882840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:54.883488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:54.890408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.890887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.891306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:54.891990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:54.892460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:54.892849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:55.041817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:55.054072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3658fe23-1d62-4d16-b0b8-3926164d16e4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.175097 Oct 19 13:39:55.054747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1246/2567] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:56.081901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:56.082864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:56.090841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.091317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.091749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.092532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:56.093016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:56.093439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:56.243814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:56.256821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-72156492-040d-4b9e-9a78-0b7e510f1438 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.181162 Oct 19 13:39:56.257452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1322/2568] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:57.291817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:57.292474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:57.299602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.300082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.300532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.301268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:57.301712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:57.302132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:57.452494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:57.464236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-09977854-a8b5-4626-8afb-23d8ac298201 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.177168 Oct 19 13:39:57.464818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1247/2569] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:58.488003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:58.488624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:58.496150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.496626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.497089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.497775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:58.498219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:58.498635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:58.629658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:58.638505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-21a66892-3f69-4562-9d7e-51a058c40652 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.154488 Oct 19 13:39:58.639078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1323/2570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:39:59.662446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:39:59.663060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:39:59.666755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=26 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:39:59.670880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.671357 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.671784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.672470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:39:59.672939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:39:59.673352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:39:59.809580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:39:59.822605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-448a8d8e-e551-4925-af82-35d9b55751e5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.163881 Oct 19 13:39:59.823246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1248/2571] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:39:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:00.854365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:00.855005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:00.862139 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.862660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.863105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:00.863798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:00.864280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:00.865175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:01.039642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:01.049940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1a465642-25f9-4380-acb8-40ee4cec7bae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.201864 Oct 19 13:40:01.050523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1324/2572] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:02.079164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:02.080006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:02.090436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.090906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.091334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.092013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:02.092545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:02.092999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:02.234617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:02.244000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c11fac2f-04dd-4609-9dc1-21b93d334272 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171653 Oct 19 13:40:02.244845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1249/2573] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:03.271118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:03.272078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:03.280552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.281079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.281522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.282228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:03.282680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:03.283114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:03.419607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:03.428620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1093a239-3781-4e92-afc2-007f9576510b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.164165 Oct 19 13:40:03.429207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1325/2574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:04.453411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:04.454079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:04.461935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.462503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.462959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.463725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:04.464405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:04.465007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:04.618563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:04.632160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9a47d625-2345-472c-8c2e-08448f9052b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.183294 Oct 19 13:40:04.632969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1250/2575] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:05.661552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:05.662461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:05.673729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.674531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.675253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.676398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:05.677192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:05.677922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:05.682176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=78 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:05.813992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:05.822855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af123a43-97cb-417e-9786-847a628a0dcd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168019 Oct 19 13:40:05.823570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1326/2576] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:06.847787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:06.848505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:06.857248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.857737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.858192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:06.858889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:06.859318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:06.859735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:07.009534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:07.024768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2642efe-210a-46a4-87bc-5c4ceb8ca4cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.181672 Oct 19 13:40:07.025568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1251/2577] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:08.053519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:08.054481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:08.065734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.066538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.067261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.068418 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:08.069228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:08.069945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:08.233615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:08.246185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b017b48-f54c-457d-92a0-2d26d4cdf1d6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.198967 Oct 19 13:40:08.247544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1327/2578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:09.273960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:09.275072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:09.283327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.283803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.284235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.284964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:09.285410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:09.285829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:09.429809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:09.438685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-13ade435-60b1-4061-bc41-19334d7d7dd9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.171591 Oct 19 13:40:09.439258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1252/2579] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:10.464300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:10.465229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:10.474289 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.474907 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.475448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.476381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:10.477026 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:10.477567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:10.613566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:10.627393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4a134d6c-77d9-495e-84f4-b9e1cab95fe0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.168008 Oct 19 13:40:10.628270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1328/2580] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:11.659411 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:11.660192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:11.669265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.670180 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.670776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.671685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:11.672286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:11.672845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:11.814283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:11.826909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd53f9e9-9c08-4dbb-b32f-015af90f02aa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.173560 Oct 19 13:40:11.827517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1253/2581] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:12.853273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:12.853913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:12.861940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.862423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.862854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:12.863538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:12.863993 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:12.864760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:13.024819 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:13.034482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-365633cc-b09f-4907-9749-b1c86db7c9af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.187382 Oct 19 13:40:13.035056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1329/2582] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:14.062627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:14.063589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:14.075630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.076438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.077266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.077965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:14.078407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:14.078824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:14.223888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:14.232399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3d6f3f2f-5f2f-4053-9fca-c7a92c918bb9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.176665 Oct 19 13:40:14.233101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1254/2583] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:15.267596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:15.268257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:15.275635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.276144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.276608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.277376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:15.277854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:15.278298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:15.418385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:15.428737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-43a10b62-8638-468f-9c80-72fc1ca30ef1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.166722 Oct 19 13:40:15.429350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1330/2584] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:16.455856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:16.456854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:16.467659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.468446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.469350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.469811 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:16.470252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:16.470666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:16.473234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=78 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:16.620841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:16.629285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3194934c-5b41-487b-9213-273e03e0bd9f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.180000 Oct 19 13:40:16.629851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1255/2585] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:17.662332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:17.662332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:17.665457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.665457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.665457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.665990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:17.666487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:17.667202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:17.808970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:17.817457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4d55af7d-e124-4e25-a497-8dd2a95e1a3d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.167916 Oct 19 13:40:17.818024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1331/2586] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:18.841438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:18.842053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:18.849706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.850166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.850775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:18.851809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:18.852259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:18.852672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.120672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:19.133835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-17493dae-c30c-42f2-9e13-5a3ff71e1305 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1721 microversion: 2.1 time: 0.296481 Oct 19 13:40:19.134606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1256/2587] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:19.901883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0101bf0a-6484-4009-a3af-b1fe8359e58a", "name": "network-vif-deleted", "tag": "e1685fe2-fdaf-4d04-aef2-ced0d22588f1"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:40:19.918325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:19.919014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:19.919740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:19.934168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] Creating event network-vif-deleted:e1685fe2-fdaf-4d04-aef2-ced0d22588f1 for instance 0101bf0a-6484-4009-a3af-b1fe8359e58a on hv-cinder-maste Oct 19 13:40:19.941654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-4abe9ee2-d6e3-4a8f-b49d-f6835a062839 req-c1eaaa3f-da03-455d-b2e0-1b95a9b69f56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046838 Oct 19 13:40:19.942699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1332/2588] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:40:20.157698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:20.158537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:20.167029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.168147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.168591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.169761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:20.170621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:20.171044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:20.247228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:20.256681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f4f7ef39-f898-4f8b-9fb9-c03266e335e0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102917 Oct 19 13:40:20.257300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1257/2589] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:21.281838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:21.282531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:21.289621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.290109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.290543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.291246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:21.291698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:21.292140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:21.365087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:21.375030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2995c852-60fa-4097-9ead-71d305cdbcda tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098221 Oct 19 13:40:21.375968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1333/2590] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:22.408300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:22.408949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:22.415822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.416298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.416776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.417493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:22.417936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:22.418347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:22.480928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:22.489798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-786ae67c-abaf-48b8-8919-787d1b6a007c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.087498 Oct 19 13:40:22.490362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1258/2591] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:23.517447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:23.518234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:23.525400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.525881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.526317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.527008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:23.527451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:23.527865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:23.606265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:23.616990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fc33b796-a50b-45a8-bb1e-c6fd585e791d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.106468 Oct 19 13:40:23.617599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1334/2592] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:24.644360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:24.645368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:24.656295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.657148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.658000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.658693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:24.659134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:24.659554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:24.736011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:24.745698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4953ed19-55e8-4826-b0ce-39faacb2608c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.107976 Oct 19 13:40:24.746311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1259/2593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:25.770831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:25.771474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:25.773965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:25.779710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.780199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.780632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.781350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:25.781804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:25.782225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:25.846976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:25.855323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7a1c7f13-e567-4484-b395-9b1a6af6efb1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090137 Oct 19 13:40:25.855915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1335/2594] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:26.881351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:26.881958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:26.888828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.889345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.889776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.890453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:26.890902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:26.891317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:26.959756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:26.968481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0f14676f-bc58-435c-8af1-fd4b425306ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092009 Oct 19 13:40:26.969073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1260/2595] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:27.995173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:27.995877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:28.004937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.005584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.006211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.007144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:28.007787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:28.008346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:28.078460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:28.087931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5026a304-63c8-4ff0-82e9-0fcff4d24501 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098740 Oct 19 13:40:28.088504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1336/2596] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:29.116139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:29.117192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:29.128531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.129055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.129482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.130154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:29.130602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:29.131017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:29.202953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:29.212075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ceb01290-2a44-4c67-85e3-66cc06a0baee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103588 Oct 19 13:40:29.212638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1261/2597] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:30.238210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:30.239205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:30.246504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.246994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.247429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.248127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:30.248576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:30.249034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:30.314846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:30.323996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9822272f-1c4c-453c-94da-c22b694de28b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091556 Oct 19 13:40:30.324588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1337/2598] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:31.349595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:31.350205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:31.352581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:31.358168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.358680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.359102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.359771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:31.360216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:31.360632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:31.436300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:31.445405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-283c4c3b-af18-42b4-afbd-b85cf2c73efa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100457 Oct 19 13:40:31.445944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1262/2599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:32.472413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:32.473280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:32.483004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.483692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.484312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.485339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:32.485992 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:32.486725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:32.552977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:32.561884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0885305b-252b-4ea0-8607-903a21869af4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095501 Oct 19 13:40:32.562489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1338/2600] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:33.588983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:33.589846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:33.599217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.599692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.600119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.600800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:33.601272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:33.601691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:33.668739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:33.677306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-31cd53c5-c54a-4877-9854-128c50b1f1ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094876 Oct 19 13:40:33.677865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1263/2601] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:34.704087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:34.705039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:34.712559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.713063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.713493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.714176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:34.714628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:34.715046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:34.786478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:34.795195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-67e9c9d4-f01e-4fb6-81ca-754d71b5efaa tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097748 Oct 19 13:40:34.795767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1339/2602] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:35.819778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:35.820378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:35.828214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.828744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.829250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.830004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:35.830695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:35.831293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:35.897910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:35.910112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb3dba6b-024e-41b2-b136-9bd5740edef8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095086 Oct 19 13:40:35.910679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1264/2603] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:36.937219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:36.938260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:36.949526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.950338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.951069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.952266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:36.953039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:36.953792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:36.957629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=80 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:37.032762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:37.046001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bffa5e34-f768-42d0-ad72-9a761b885e74 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.115022 Oct 19 13:40:37.046874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1340/2604] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:38.071808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:38.072415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:38.079715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.080222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.080922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.081674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:38.082143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:38.082576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:38.155137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:38.165569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-73fc9d9a-0059-4b0f-9303-379e0426279f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097916 Oct 19 13:40:38.166134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1265/2605] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:39.194138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:39.195057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:39.206099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.206668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.207120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.207842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:39.208292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:39.208707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:39.280464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:39.289405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-25481953-185b-4f65-9fc1-8f95662e6cf7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102933 Oct 19 13:40:39.289991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1341/2606] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:40.316657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:40.317372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:40.323998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.324482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.324931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.325624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:40.326067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:40.326482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:40.388301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:40.397206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6d9dd697-e7b5-4b58-bed0-3058ae37a4a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.086399 Oct 19 13:40:40.397768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1266/2607] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:41.423989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:41.425462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:41.432999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.433537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.434022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.434795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:41.435300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:41.435779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:41.509457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:41.518152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b542914d-ff5b-4c2a-b328-0f36cb922dd3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100587 Oct 19 13:40:41.518817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1342/2608] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:42.543922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:42.544544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:42.554589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.555188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.555798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.556495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:42.556969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:42.557396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:42.625189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:42.633800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9c829d9b-4f2a-4bcf-bc22-ce9778cb5225 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096108 Oct 19 13:40:42.634369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1267/2609] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:43.660786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:43.661717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:43.672558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.673399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.674099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.674980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:43.675439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:43.675867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:43.742153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:43.750872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aaeab5d7-5290-4d59-8910-1ed9f8e88c2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096628 Oct 19 13:40:43.751540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1343/2610] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:44.777937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:44.778908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:44.787623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.788114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.788546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.789272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:44.789723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:44.790144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:44.852636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:44.860925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a392ba4b-0501-43e8-aa22-f53ca6a26879 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089604 Oct 19 13:40:44.861514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1268/2611] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:45.887732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:45.888680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:45.897482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.897972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.898411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.899109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:45.899564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:45.900000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:45.965127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:45.973472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-aee11c57-8d36-4562-bb2c-c23dafbc736c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092254 Oct 19 13:40:45.974036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1344/2612] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:47.000664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:47.001764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:47.009281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.009765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.010194 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.010883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:47.011335 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:47.011739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:47.014346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:47.077301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:47.085918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4e9533d9-5fe3-43d5-bdde-8aff68d99181 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091757 Oct 19 13:40:47.086478 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1269/2613] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:48.113570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:48.114322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:48.122258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.122829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.123346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.124153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:48.124686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:48.125217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:48.190753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:48.203719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b6fb8073-03fd-433f-83ee-d9be9519b293 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097023 Oct 19 13:40:48.204482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1345/2614] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:49.230618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:49.231498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:49.242182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.242935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.243640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.244818 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:49.245576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:49.246270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:49.312497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:49.321340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-01932df7-38a1-47c4-8d53-14946e56a24f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097131 Oct 19 13:40:49.321904 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1270/2615] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:50.344020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:50.344631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:50.351529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.352010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.352431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.353150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:50.353603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:50.354028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:50.422603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:50.431225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d01489ac-e40f-4ebf-a6d9-f8dbec95144c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091118 Oct 19 13:40:50.431798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1346/2616] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:51.458259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:51.459166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:51.470078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.470987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.471418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.472089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:51.472529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:51.472966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:51.540837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:51.549705 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35777d9a-9030-4bb6-b4ab-2feab9ab40a9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097947 Oct 19 13:40:51.555831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1271/2617] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:52.576471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:52.577388 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:52.585526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.586012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.586467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:52.587155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:52.587595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:52.588019 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:52.650790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:52.659107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d8b0b8cb-115d-4e45-b1ee-e2f7ebaec8bf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089340 Oct 19 13:40:52.659639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1347/2618] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:53.686028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:53.686966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:53.695262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:53.695757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:53.696154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:53.696852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:53.697306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:53.697716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:53.770329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:53.778884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f095dbca-92de-424c-bc1d-501214124d2b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099643 Oct 19 13:40:53.779448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1272/2619] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:54.803711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:54.804298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:54.811552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.812034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.812461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:54.813181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:54.813626 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:54.814044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:54.876302 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:54.884693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e3424726-aea0-4cc6-a22e-8ddd82252ea5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.084941 Oct 19 13:40:54.885255 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1348/2620] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:55.907531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:55.908192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:55.914748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:55.915234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:55.915660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:55.916341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:55.916779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:55.917219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:56.088373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:56.097233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bf28d85c-6611-4e9d-9c3b-a7b839bd5c3b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.193524 Oct 19 13:40:56.097800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1273/2621] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:57.124571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:57.125547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:57.129182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:40:57.138242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.139041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.139768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.140924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:57.141691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:57.142393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:57.224055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:57.232853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-645545e5-4286-4f03-958f-2c3c458e6043 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.115360 Oct 19 13:40:57.233473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1349/2622] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:58.260212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:58.261144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:58.272118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.272943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.273683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.274823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:58.275563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:58.276290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:58.346792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:58.356062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b155a9da-edb8-4f75-9c75-df41ff7ccf5d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102647 Oct 19 13:40:58.356602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1274/2623] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:40:59.383649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:40:59.384636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:40:59.395636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.396113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.396543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:59.397257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:40:59.397703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:40:59.398441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:40:59.463838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:40:59.472884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5bd66a50-ce53-4229-90e5-aae40e49cb2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096020 Oct 19 13:40:59.473460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1350/2624] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:40:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:00.499867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:00.500812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:00.509604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:00.510084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:00.510515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:00.511198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:00.511645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:00.512060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:00.576407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:00.585055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dca20c9a-9dc4-4167-8753-a8dec78467ad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091535 Oct 19 13:41:00.585612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1275/2625] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:01.607886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:01.608522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:01.616258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.616747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.617221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.617914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:01.618369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:01.618794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:01.688651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:01.697264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ccaf3977-75b3-49b4-8126-c024088595e9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093315 Oct 19 13:41:01.697830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1351/2626] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:02.723894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:02.724516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:02.726790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:02.732377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.732898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.733317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.734008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:02.734459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:02.734880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:02.804284 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:02.817483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6ba0dc3f-2155-4cbb-b0ed-fd81ffe0f548 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099124 Oct 19 13:41:02.818062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1276/2627] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:03.845753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:03.846831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:03.858027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.858825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.859553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.860689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:03.861540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:03.862315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:03.925601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:03.934548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-26cea6ef-ad2d-4c8f-adad-c8133d826e38 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095309 Oct 19 13:41:03.935117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1352/2628] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:04.961671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:04.962695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:04.973732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.974217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.974649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:04.975337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:04.975788 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:04.976211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:05.049635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:05.058587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e6fa5a73-8709-4c89-8db5-02ff547f68dc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103576 Oct 19 13:41:05.059155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1277/2629] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:06.085127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:06.085750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:06.092618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:06.093140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:06.093573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:06.094273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:06.094730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:06.095148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:06.159815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:06.168246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b0c8ed5c-1b1c-4666-93e9-6e5e1fec856f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088251 Oct 19 13:41:06.168817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1353/2630] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:07.191696 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:07.192288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:07.199330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:07.199812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:07.200246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.200966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:07.201424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:07.201843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:07.264421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:07.273255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e756d913-8d41-4250-b4ec-b3edf625a7a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.085701 Oct 19 13:41:07.273821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1278/2631] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:08.300557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:08.301839 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:08.308681 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.309138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.309610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.310312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:08.310771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:08.311198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:08.313868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:08.532496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:08.540734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a7fe506e-42ba-4f96-860c-bb1bfe329062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.246813 Oct 19 13:41:08.541461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1354/2632] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:09.568045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:09.568744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:09.576727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.577336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.577836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.578630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:09.579138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:09.579624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:09.644599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:09.652905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6052dc84-8399-4a45-b993-b993c8ee2537 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091291 Oct 19 13:41:09.653483 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1279/2633] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:10.678520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:10.679253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:10.687166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.687717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.688199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.689009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:10.689515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:10.689988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:10.758915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:10.767259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d25dc8eb-0d55-4acc-a97c-ee7ac0e61983 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094736 Oct 19 13:41:10.767816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1355/2634] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:11.795062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:11.796033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:11.807732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:11.808464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:11.809241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:11.810371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:11.811110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:11.811807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:11.885900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:11.898074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-890fb5fc-afa0-4664-a4e2-e208983768b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.109311 Oct 19 13:41:11.898893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1280/2635] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:12.929299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:12.929961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:12.937506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.938046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.938564 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:12.939333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:12.939841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:12.940316 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:13.008885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:13.017573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f0858100-c23d-4cbd-948a-2111f9143152 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094246 Oct 19 13:41:13.018138 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1356/2636] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:14.044722 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:14.045755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:14.057354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.058143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.058849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.059963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:14.060695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:14.061422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:14.128793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:14.137473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1186cbd9-5f1a-4dca-91c7-9e52271c7a2e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099171 Oct 19 13:41:14.138011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1281/2637] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:15.164494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:15.165481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:15.176423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:15.177180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:15.177642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:15.178347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:15.178784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:15.179202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:15.251101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:15.259448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c0cf0058-a3a3-4c42-bb8d-5fe8373e2e1d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.101943 Oct 19 13:41:15.260003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1357/2638] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:16.420777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:16.421462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:16.430856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:16.431496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:16.432092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:16.433120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:16.433741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:16.434271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:16.505450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:16.514591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4d2b272a-c494-4175-9ea4-d962e5de79cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.234621 Oct 19 13:41:16.515130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1282/2639] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:17.544205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:17.545247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:17.550173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:41:17.550464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:41:17.561927 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:17.562489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:17.562996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:17.563812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:17.564327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:17.564817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:17.643750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:17.652486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1fbc214d-d299-4130-82e0-be4fba0ba6ed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.114748 Oct 19 13:41:17.653074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1358/2640] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:18.679901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:18.680812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:18.691061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:18.691840 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:18.692573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:18.693458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:18.693894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:18.694306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:18.696817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:18.756905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:18.765361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-acf43fb5-4233-4e8c-82d2-2609108ee55b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092498 Oct 19 13:41:18.765920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1283/2641] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:19.792003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:19.792998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:19.803299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:19.803943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:19.804384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:19.805128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:19.805584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:19.806010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:19.873063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:19.881889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cb71ddce-ab27-4b5b-b7c4-0c8f6c0b6ecb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096805 Oct 19 13:41:19.882459 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1359/2642] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:20.903644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:20.904225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:20.910892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:20.911362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:20.911902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:20.912518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:20.912967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:20.913384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:20.977952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:20.986430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-de460190-65b0-41dd-94b8-ab5bb9922670 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.086622 Oct 19 13:41:20.987002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1284/2643] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:22.010143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:22.010961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:22.017987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:22.018448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:22.018916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:22.019612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:22.020065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:22.020490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:22.088277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:22.096810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a827c6e3-c3a3-4d4d-b5b6-eeaabdc24d62 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090582 Oct 19 13:41:22.097400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1360/2644] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:23.120052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:23.120782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:23.127563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:23.128150 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:23.128649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:23.129410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:23.129862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:23.130297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:23.196617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:23.205844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e56362af-771e-43bf-adfe-08c4d58c46b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089971 Oct 19 13:41:23.206405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1285/2645] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:24.229702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:24.230323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:24.239009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:24.239678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:24.240319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:24.241113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:24.241591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:24.242035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:24.307376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:24.320583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-af88a5a4-1974-405b-b657-a4ae43e4857d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094898 Oct 19 13:41:24.321487 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1361/2646] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:25.348902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:25.349606 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:25.356683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:25.357188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:25.357611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:25.358288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:25.358729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:25.359141 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:25.424548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:25.433462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c2cb83d9-f295-42be-9efe-4c3628912e59 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088602 Oct 19 13:41:25.434028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1286/2647] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:26.459729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:26.460402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:26.467682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:26.468184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:26.468610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:26.469393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:26.469862 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:26.470301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:26.539024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:26.547918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4780acb7-d50d-466d-b005-9e50b69e4efe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094434 Oct 19 13:41:26.548484 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1362/2648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:27.575222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:27.576125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:27.587363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:27.588136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:27.588841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:27.590028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:27.590715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:27.591405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:27.671069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:27.679893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-63e50685-bfab-4053-8068-7d59467250ca tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.111702 Oct 19 13:41:27.680452 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1287/2649] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:28.707413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:28.708325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:28.712918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:28.716783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:28.717305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:28.717739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:28.718432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:28.718880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:28.719301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:28.782767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:28.791547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d535f0fc-ebe4-449d-81d7-d6cf24c59529 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090871 Oct 19 13:41:28.792100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1363/2650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:29.823296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:29.823945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:29.831611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:29.832148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:29.832627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:29.833426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:29.833922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:29.834390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:29.898931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:29.907761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1f60e7a2-9bba-4fac-9e41-573f3bafa778 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090365 Oct 19 13:41:29.908327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1288/2651] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:30.935789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:30.936790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:30.947768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:30.948577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:30.949382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:30.950521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:30.951314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:30.952057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:31.020113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:31.028817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-89afd3b9-4822-4951-a392-3b4c67ac5751 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100291 Oct 19 13:41:31.029423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1364/2652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:32.059825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:32.060796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:32.071720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.072198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.072626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.073350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:32.073797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:32.074218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:32.145420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:32.154901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b7156aae-1dbc-43da-b8be-eb72dbacce64 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102379 Oct 19 13:41:32.155456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1289/2653] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:33.181349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:33.181967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:33.189253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.189737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.190171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:33.190858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:33.191309 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:33.191733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:33.253426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:33.262162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f7e9989e-5723-4929-8c2b-213d4b88444c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.086357 Oct 19 13:41:33.263001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1365/2654] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:34.289526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:34.290204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:34.292801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:34.298485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:34.298977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:34.299398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:34.300087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:34.300528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:34.300954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:34.363902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:34.375438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c97686db-a523-4ace-aa51-f15cc72b6182 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092558 Oct 19 13:41:34.376208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1290/2655] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:35.405009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:35.406039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:35.417151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.417957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.418696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.419841 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:35.420602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:35.421350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:35.486830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:35.495662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-168b4de7-eb76-4722-971f-68396606c54b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097744 Oct 19 13:41:35.496229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1366/2656] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:36.530921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:36.531889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:36.541893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.542368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.542792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.543474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:36.543912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:36.544323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:36.610540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:36.620065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f75ca43d-ff7c-4fa7-85d6-0d71f1db3efd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095748 Oct 19 13:41:36.620630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1291/2657] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:37.647713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:37.648584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:37.655971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:37.656451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:37.656904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:37.657610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:37.658073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:37.658519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:37.729760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:37.744333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-df793195-48e5-4079-b466-f64a01aae65b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103140 Oct 19 13:41:37.745276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1367/2658] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:38.776919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:38.777972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:38.788943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.789937 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.790394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.791091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:38.791560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:38.791969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:38.853513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:38.861871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2a68fa0a-85f5-4a92-a25e-8bceebc6428f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091565 Oct 19 13:41:38.862777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1292/2659] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:39.885913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:39.886527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:39.893188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.893669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.894107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.894798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:39.895253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:39.895676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:39.899781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:39.961358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:39.970166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-41b1e67e-fd1a-4df4-bdf3-8396838f9823 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088344 Oct 19 13:41:39.970754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1368/2660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:40.997575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:40.998535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:41.009294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:41.009770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:41.010193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:41.010881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:41.011297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:41.011734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:41.085823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:41.106494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2d863b26-2e3e-4ef2-ae86-4915eca57457 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.115293 Oct 19 13:41:41.107336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1293/2661] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:42.137972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:42.139032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:42.149887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:42.150376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:42.150812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:42.151507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:42.151960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:42.152394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:42.214247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:42.222587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ac106e0b-fd89-42da-87d5-32a0ce6ab262 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091244 Oct 19 13:41:42.223148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1369/2662] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:43.251749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:43.252641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:43.262365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:43.262851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:43.263279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:43.263965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:43.264410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:43.264827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:43.335275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:43.344154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8041e822-ef17-4ce2-94b5-879d502d7851 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099102 Oct 19 13:41:43.344736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1294/2663] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:44.367826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:44.368436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:44.375549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:44.376032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:44.376507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:44.377228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:44.377684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:44.378104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:44.442958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:44.464990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2ae1e06d-330c-40a7-aead-be69f42003ef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100770 Oct 19 13:41:44.466006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1370/2664] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:45.492484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:45.493516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:45.505023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.505763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.507045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.508158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:45.508962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:45.509841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:45.574679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:45.583011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0a1958a9-0809-43bb-8de8-3a5ad7ff3dd5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097411 Oct 19 13:41:45.583574 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1295/2665] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:46.608095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:46.608685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:46.616148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:46.616630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:46.617103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:46.617786 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:46.618231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:46.618761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:46.680121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:46.688834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-518f37d5-7958-4d7d-879b-85a447b4c943 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.084967 Oct 19 13:41:46.689429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1371/2666] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:47.715963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:47.716848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:47.726960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:47.727741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:47.728503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:47.729191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:47.729635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:47.730041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:47.790858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:47.799571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e2844d18-cfbd-46d2-b8d4-79a34c62b255 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090517 Oct 19 13:41:47.800138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1296/2667] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:48.826508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:48.827518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:48.838431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:48.838915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:48.839351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:48.840028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:48.840480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:48.840933 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:48.916194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:48.924703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a9abcc2e-3330-4763-b15a-d9cb288625a7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.105073 Oct 19 13:41:48.925383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1372/2668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:49.947651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:49.948250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:49.955068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:49.955554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:49.955987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:49.956672 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:49.957160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:49.957564 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:49.960156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:41:50.028376 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:50.037210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-da6826b3-d0ee-41d8-80b0-f5ba6ff9db30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093657 Oct 19 13:41:50.037797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1297/2669] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:51.064781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:51.065696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:51.074872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:51.075347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:51.075779 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:51.076485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:51.076947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:51.077392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:51.139277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:51.147957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7cba164e-dd10-4081-9436-e1daad7c29de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089770 Oct 19 13:41:51.148527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1373/2670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:52.180921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:52.181891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:52.189349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:52.189824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:52.190253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:52.190938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:52.191381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:52.191798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:52.253734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:52.262250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-acc9c498-8628-4a01-a4af-eb56b52c4f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.087758 Oct 19 13:41:52.262823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1298/2671] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:53.289235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:53.290145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:53.297809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:53.298295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:53.298728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:53.299420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:53.299869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:53.300284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:53.365544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:53.374334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8183af34-162e-47d1-8f5f-273e68196478 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091839 Oct 19 13:41:53.374876 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1374/2672] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:54.401114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:54.402175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:54.409608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:54.410095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:54.410524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:54.411244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:54.411694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:54.412115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:54.482784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:54.491737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c319f0d-224e-4c2c-a63c-b70ec2e9d4ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097147 Oct 19 13:41:54.492485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1299/2673] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:55.518940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:55.519898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:55.530769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:55.531560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:55.532275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:55.533448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:55.534235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:55.534932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:55.600799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:55.609168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f4d924f2-6493-4036-b116-21af2bcfc326 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096817 Oct 19 13:41:55.609722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1375/2674] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:56.644062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:56.645083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:56.654424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:56.654911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:56.655345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:56.656042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:56.656491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:56.656907 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:56.718466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:56.727319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-81a2a041-6d74-43d7-a579-3acacd4ad8ff tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089918 Oct 19 13:41:56.727886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1300/2675] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:57.761552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:57.762417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:57.770578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:57.771243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:57.771741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:57.772544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:57.773130 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:57.773627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:57.841784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:57.850187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2bdc2494-b23d-4ad7-85a2-e341c7a387d7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095352 Oct 19 13:41:57.850750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1376/2676] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:58.874757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:58.875365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:58.882220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:58.882690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:58.883116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:58.883793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:41:58.884232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:41:58.884645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:41:58.955489 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:41:58.964441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bbe08b23-f255-49a9-a691-1c223c611217 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093701 Oct 19 13:41:58.965029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1301/2677] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:41:59.992101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:41:59.993084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:41:59.996742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:00.005673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:00.006465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:00.007180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:00.008301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:00.009105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:00.009802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:00.090311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:00.099140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f575fadb-d6b0-43cb-b994-3bada1477cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.114085 Oct 19 13:42:00.099716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1377/2678] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:41:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:01.129480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:01.130530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:01.142082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:01.142868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:01.143571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:01.144697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:01.145486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:01.146183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:01.211760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:01.220482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-77cabe61-d807-4dd8-8693-5e07c2fa2c1a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097630 Oct 19 13:42:01.221283 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1302/2679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:02.249721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:02.250690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:02.261580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:02.262375 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:02.263102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:02.264226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:02.265120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:02.265547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:02.326718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:02.335256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4c3641c4-b319-408d-8424-66d143361ed5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092144 Oct 19 13:42:02.335808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1378/2680] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:03.358463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:03.359021 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:03.366510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.366986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.367410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.368084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:03.368523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:03.368962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:03.430736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:03.439502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eaf096f7-ec6a-4242-b28c-7b9df13b8236 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.084939 Oct 19 13:42:03.440067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1303/2681] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:04.466258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:04.467268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:04.478529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:04.479352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:04.480113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:04.481307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:04.482064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:04.482767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:04.547165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:04.555728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-869c0125-00bf-4cca-978d-02221a009b0e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096096 Oct 19 13:42:04.556287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1379/2682] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:05.583005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:05.583900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:05.587714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:05.595317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:05.595798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:05.596219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:05.596894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:05.597381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:05.597780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:05.670265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:05.678442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-df37fb08-db83-448a-bc35-cda5e3267a7d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102369 Oct 19 13:42:05.678993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1304/2683] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:06.704666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:06.705321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:06.712591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:06.713141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:06.713600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:06.714329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:06.714805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:06.715248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:06.780352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:06.789180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f033bdfc-39ca-4d56-8cce-b4408bf5a15b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089998 Oct 19 13:42:06.789732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1380/2684] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:07.819069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:07.820075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:07.831303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:07.832123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:07.832807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:07.833980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:07.834771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:07.835460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:07.904968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:07.913741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9882100f-f7a7-47a1-81ad-311bb31eab40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.101226 Oct 19 13:42:07.914313 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1305/2685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:08.940515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:08.941574 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:08.952643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:08.953165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:08.953601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:08.954296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:08.954751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:08.955175 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:09.019457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:09.027800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b7f7b69b-c55a-4301-be51-55e4dca30419 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093829 Oct 19 13:42:09.028377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1381/2686] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:10.054569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:10.055590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:10.065550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:10.066137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:10.066678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:10.067518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:10.068067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:10.068618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:10.144068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:10.156887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-07439447-6bf9-430b-9157-bcec8dcc42e1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.108749 Oct 19 13:42:10.157460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1306/2687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:11.184285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:11.185206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:11.196170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:11.196981 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:11.197738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:11.198824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:11.199607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:11.200303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:11.203803 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:11.262943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:11.271678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5579f114-0eb4-44a7-a43e-1ccc92ba7383 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093973 Oct 19 13:42:11.272243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1382/2688] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:12.297743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:12.298835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:12.314883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:12.314883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:12.314883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:12.314883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:12.315390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:12.315390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:12.377906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:12.386649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35cc5e3d-1a7d-412d-9536-a73378c0dd9c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095525 Oct 19 13:42:12.387244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1307/2689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:13.414027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:13.414964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:13.424328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:13.424815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:13.425278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:13.425970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:13.426421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:13.426857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:13.488882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:13.497630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-08514de2-affd-4bb7-b522-be22a3462052 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090302 Oct 19 13:42:13.498197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1383/2690] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:14.525185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:14.526107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:14.535087 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:14.535569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:14.535993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:14.536676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:14.537153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:14.537559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:14.608340 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:14.617656 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b2ebf29f-bfd7-4a50-8492-7c499e67ec12 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099031 Oct 19 13:42:14.618231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1308/2691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:15.644501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:15.645443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:15.656222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:15.657091 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:15.657806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:15.658929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:15.659676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:15.660370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:15.730812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:15.741129 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6778e7b0-77e7-4f4a-8c73-85f0a21ac334 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103226 Oct 19 13:42:15.741705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1384/2692] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:16.768702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:16.769744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:16.779842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:16.781147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:16.781496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:16.782617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:16.782757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:16.783274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:16.848353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:16.856876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-13bd5e12-7286-4590-abfb-4a028a2d6a07 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095206 Oct 19 13:42:16.857477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1309/2693] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:17.890596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:17.891233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:17.898535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:17.899043 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:17.899501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:17.900225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:17.900703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:17.901174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:17.971583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:17.980176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-660999fe-508d-41ff-8f85-f60c2d4a267b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096215 Oct 19 13:42:17.980730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1385/2694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:19.003236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:19.004784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:19.012360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:19.012663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:19.013143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:19.013841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:19.014480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:19.014900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:19.084255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:19.092854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4cb729ca-09ab-4560-9117-b5226019e5ea tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093901 Oct 19 13:42:19.093616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1310/2695] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:20.121119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:20.122312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:20.134596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:20.135448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:20.136171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:20.137358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:20.138122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:20.138842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:20.213096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:20.221745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dfb37f11-a1a4-4249-abb9-51e178770ad9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.107311 Oct 19 13:42:20.222428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1386/2696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:21.245617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:21.246218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:21.253403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:21.253951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:21.254297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:21.255012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:21.255485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:21.255892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:21.258875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:21.321545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:21.336473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e30c127-71cc-4ab4-b740-186eb0088ea8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094590 Oct 19 13:42:21.337232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1311/2697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:22.361975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:22.362611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:22.370053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:22.370541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:22.370978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:22.371670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:22.372123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:22.372547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:22.436618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:22.445306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-613a4221-a7f9-43ee-a060-8e2a73f34814 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089638 Oct 19 13:42:22.445844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1387/2698] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:23.468252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:23.468910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:23.475966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:23.476444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:23.476899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:23.477627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:23.478081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:23.478560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:23.548614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:23.556747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ab3953c7-8f01-45f1-987b-77ffaf26b37a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092497 Oct 19 13:42:23.557355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1312/2699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:23 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:24.583605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:24.584477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:24.592285 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:24.592799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:24.593403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:24.594118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:24.594569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:24.594971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:24.667023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:24.675494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9b2530c0-91bb-4f51-aff5-71189e8e3ff9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097951 Oct 19 13:42:24.676052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1388/2700] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:25.698916 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:25.699515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:25.707734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:25.708235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:25.708644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:25.709838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:25.710330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:25.710742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:25.799973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:25.809644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-472fba10-b1ac-4a82-8e9c-a8889595aeb7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.114869 Oct 19 13:42:25.810189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1313/2701] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:26.835820 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:26.836468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:26.843679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:26.844171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:26.844596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:26.845320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:26.845762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:26.846205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:26.914716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:26.923236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a59d45f0-42dc-495c-92f3-e21a0ea6cf30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091342 Oct 19 13:42:26.923831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1389/2702] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:27.950001 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:27.951000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:27.962174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:27.962960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:27.963673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:27.964801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:27.965629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:27.966281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:28.033447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:28.041986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3b643911-4d2c-4260-9654-99e613ac9fce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098665 Oct 19 13:42:28.042734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1314/2703] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:29.069210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:29.070298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:29.080468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:29.080995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:29.081439 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:29.082117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:29.082582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:29.082997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:29.145600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:29.154031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-73356000-1b18-41b9-8f66-62cdda4435a5 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091417 Oct 19 13:42:29.154595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1390/2704] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:30.187002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:30.188768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:30.199263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:30.204250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:30.204738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:30.205498 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:30.205946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:30.206402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:30.280286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:30.290286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-78bcd217-67a8-46ad-857c-2569f5e187bc tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.109678 Oct 19 13:42:30.290863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1315/2705] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:31.315609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:31.316072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:31.318511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:31.324041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:31.324562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:31.324988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:31.325678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:31.326125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:31.326541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:31.388312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:31.397010 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae2436ab-437a-4bbb-be09-87b220efc18c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.085501 Oct 19 13:42:31.397591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1391/2706] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:32.423827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:32.424505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:32.432374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:32.432966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:32.433440 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:32.434187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:32.434677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:32.435127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:32.498991 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:32.507600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1cae3be2-e5b5-457d-948b-5065250e60c2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090303 Oct 19 13:42:32.508172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1316/2707] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:33.534587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:33.535360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:33.544000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:33.544599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:33.545204 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:33.546103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:33.546658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:33.547178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:33.614082 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:33.622489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ca9abe6b-3806-4463-ab16-858f07c6edcf tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094486 Oct 19 13:42:33.623050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1392/2708] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:33 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:34.649747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:34.650639 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:34.661752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:34.662535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:34.663244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:34.664331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:34.665133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:34.665814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:34.734603 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:34.743393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ffb9e095-f4e3-49d7-bd8e-818a46681483 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100556 Oct 19 13:42:34.743946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1317/2709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:35.770679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:35.771625 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:35.782560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:35.783445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:35.783882 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:35.784579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:35.785070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:35.785496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:35.855558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:35.864905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9fe816e4-e024-4357-a0a7-7a8ac64aa8b7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100895 Oct 19 13:42:35.865483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1393/2710] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:36.888328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:36.888966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:36.891633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:36.897393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:36.897863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:36.898286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:36.898961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:36.899393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:36.899804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:36.964516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:36.976779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8196c0ec-5f54-46b2-8df7-e901203bfcb4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092241 Oct 19 13:42:36.977607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1318/2711] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:38.003185 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:38.003811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:38.010579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.011079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.011509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.012207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:38.012648 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:38.013141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:38.075510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:38.083855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-43ad69c1-1722-44f7-a2d6-899d8d8df6e6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.086905 Oct 19 13:42:38.084421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1394/2712] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:39.111328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:39.112005 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:39.119359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:39.119866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:39.120319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:39.121210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:39.121682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:39.122121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:39.190834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:39.199269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd1a8be0-86a3-4617-b8ce-8f01c253bdc1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094977 Oct 19 13:42:39.199837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1319/2713] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:40.222747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:40.223509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:40.230423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:40.230922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:40.231334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:40.232027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:40.232474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:40.232917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:40.297475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:40.307631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9bcf576d-3974-4b34-ab30-6805172f38b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088987 Oct 19 13:42:40.308171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1395/2714] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:41.334715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:41.335295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:41.342144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:41.342616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:41.343042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:41.343726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:41.344165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:41.344575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:41.415303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:41.423958 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6e21e57d-a325-4514-bf78-2e5067e1dee8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093222 Oct 19 13:42:41.424660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1320/2715] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:42.451191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:42.452114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:42.463135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:42.463949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:42.464765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:42.465942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:42.466685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:42.467385 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:42.471562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:42.538312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:42.551260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f56143a3-0c61-4510-95ec-c28b9d0e3974 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.106265 Oct 19 13:42:42.552040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1396/2716] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:42 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:43.578430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:43.579360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:43.587690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.588169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.588602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.589318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:43.589762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:43.590183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:43.656143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:43.665209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-65aedb80-c767-40b5-a4f2-c46a1ca3f318 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093533 Oct 19 13:42:43.665772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1321/2717] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:44.692509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:44.693257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:44.701584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:44.702200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:44.702726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:44.703569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:44.704125 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:44.704646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:44.769567 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:44.777860 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5b810093-c37c-4dcc-b447-dbfbcd39bca3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092070 Oct 19 13:42:44.778421 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1397/2718] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:45.801050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:45.801645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:45.808535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:45.809040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:45.809465 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:45.810137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:45.810578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:45.810984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:45.876466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:45.885504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-517f8de0-3677-43a9-89b4-1bc599a02d0f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088434 Oct 19 13:42:45.886059 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1322/2719] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:46.909028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:46.909787 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:46.916239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:46.916719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:46.917171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:46.917855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:46.918326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:46.918744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:46.982624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:46.992176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b4bf598c-cbee-4826-a70b-e073f9a2165f tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.087074 Oct 19 13:42:46.992769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1398/2720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:48.020409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:48.021420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:48.029936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:48.030531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:48.030982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:48.031744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:48.032248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:48.032670 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:48.109619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:48.118640 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b5cd2eaa-2394-4b31-91f4-dc6a3fa62d0b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.105542 Oct 19 13:42:48.119205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1323/2721] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:49.146573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:49.147472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:49.158478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:49.159266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:49.160397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:49.161025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:49.161473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:49.161915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:49.229528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:49.238706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4092e00-e552-4ad8-9eb5-ca8fe27de932 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099100 Oct 19 13:42:49.239270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1399/2722] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:50.265608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:50.266622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:50.274728 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:50.275213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:50.275643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:50.276328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:50.276769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:50.277225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:50.344266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:50.352891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b050ec62-349e-4e7c-affc-887eeb88ee5e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093872 Oct 19 13:42:50.353475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1324/2723] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:51.379881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:51.380596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:51.383214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:42:51.383428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:42:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:42:51.390932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:51.391502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:51.392024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:51.392831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:51.393401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:51.393900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:51.460059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:51.468465 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-042b2fd5-0d6e-4676-8122-29870aa011db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094864 Oct 19 13:42:51.469035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1400/2724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:51 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:52.494992 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:52.495874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:52.504896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:52.505543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:52.506116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:52.507035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:52.507641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:52.508200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:52.511613 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:42:52.829492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:52.838921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd1764ad-5c15-4cad-9517-f2a4e8d56c2d tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.349235 Oct 19 13:42:52.839461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1325/2725] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:53.867634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:53.868719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:53.879973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:53.880453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:53.880895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:53.881605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:53.882057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:53.882475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:53.953958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:53.962973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-78d1700c-79da-4a8a-859f-c0744aa439e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103353 Oct 19 13:42:53.963588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1401/2726] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:54.989404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:54.990136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:54.993301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:42:54.993496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:42:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:42:55.002384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:55.002984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:55.003609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:55.004464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:55.005063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:55.005589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:55.070232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:55.078590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-631f125e-96c9-4f6e-8061-7791b2c6c7a2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095814 Oct 19 13:42:55.079155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1326/2727] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:56.106829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:56.107731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:56.118877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:56.119666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:56.120382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:56.121540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:56.122321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:56.123024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:56.190569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:56.199752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a1ea6a21-47e4-4b62-93c2-044fdc645f26 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099561 Oct 19 13:42:56.200297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1402/2728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:57.227145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:57.228113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:57.239586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:57.240563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:57.241064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:57.241756 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:57.242172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:57.242623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:57.308768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:57.317607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0afa61c4-9bdc-45a1-9dc9-24d5851b4bad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096776 Oct 19 13:42:57.318382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1327/2729] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:58.340814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:58.341538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:58.348850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:58.349513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:58.349917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:58.350651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:58.351052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:58.351475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:58.423756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:58.432495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-35ce7631-d35e-44bf-996a-ddfd4f060bef tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095647 Oct 19 13:42:58.433177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1403/2730] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:42:59.459544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:42:59.460126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:42:59.467360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:59.467839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:59.468270 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:59.468981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:42:59.469425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:42:59.469842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:42:59.532647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:42:59.544339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c27d4a0-e561-4359-9576-176d8df23de7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090927 Oct 19 13:42:59.545112 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1328/2731] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:42:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:00.574208 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:00.575096 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:00.585765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:00.586249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:00.586676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:00.587360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:00.587802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:00.588218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:00.661837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:00.670194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bcfadc9b-9be0-4b07-b7ee-8b073b877675 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102800 Oct 19 13:43:00.670726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1404/2732] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:01.695394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:01.696081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:01.703660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:01.704188 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:01.704688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:01.705457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:01.705956 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:01.706420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:01.773266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:01.782127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-69854c15-daef-4f35-bd7a-c6354f6d00b4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092440 Oct 19 13:43:01.782688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1329/2733] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:01 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:02.809205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:02.810183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:02.813997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:02.821802 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:02.822294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:02.822765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:02.823497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:02.823953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:02.824401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:02.893496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:02.903793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c5d1ff8c-c25d-45cc-acf8-df2ec5c8c143 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.101193 Oct 19 13:43:02.904358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1405/2734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:03.930256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:03.930894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:03.937834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:03.938315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:03.938745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:03.939433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:03.939876 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:03.940294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:04.006908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:04.015940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-64ec6746-b8ef-406b-9952-aa15f362a3f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092066 Oct 19 13:43:04.016520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1330/2735] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:05.043248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:05.044283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:05.055242 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:05.056046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:05.056745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:05.057967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:05.058719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:05.059430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:05.130710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:05.139202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3670e491-e91a-4854-8917-805fec7dd31e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.102635 Oct 19 13:43:05.139770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1406/2736] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:06.167269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:06.168139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:06.179009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:06.179911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:06.180380 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:06.181081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:06.181500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:06.181946 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:06.243560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:06.251978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-becc8698-7c6a-4a45-9854-121bc4389a3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091419 Oct 19 13:43:06.252548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1331/2737] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:07.280893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:07.282024 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:07.292113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:07.292673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:07.293140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:07.293822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:07.294274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:07.294690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:07.356526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:07.365489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d87ef80d-4801-48a1-85c6-0cf977231c37 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091094 Oct 19 13:43:07.366060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1407/2738] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:08.393011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:08.394044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:08.397792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:08.403872 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:08.404346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:08.404772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:08.405484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:08.405924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:08.406336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:08.468377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:08.477019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3b99f8d1-f28b-426e-9d2e-8b8e681bca89 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090498 Oct 19 13:43:08.477615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1332/2739] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:09.510540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:09.511235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:09.519447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:09.520014 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:09.520519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:09.521376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:09.521906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:09.522400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:09.595231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:09.603744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-df21e339-b686-4b47-bf33-5665c0f9c673 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099822 Oct 19 13:43:09.604317 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1408/2740] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:09 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:10.631555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:10.632470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:10.643843 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:10.644654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:10.645422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:10.646555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:10.647355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:10.648050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:10.717967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:10.729473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3f774811-a805-417e-8159-0c2b864cf915 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.104625 Oct 19 13:43:10.730035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1333/2741] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:11.755923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:11.756850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:11.765475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:11.765953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:11.766384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:11.767065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:11.767513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:11.767929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:11.832335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:11.840573 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c2af984a-fd0c-403e-8196-a3348d5a2164 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091238 Oct 19 13:43:11.841249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1409/2742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:12.869374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:12.870602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:12.877253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:12.877800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:12.878268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:12.879040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:12.879523 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:12.879976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:12.942241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:12.951064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-583ca415-45e3-4446-884b-b55fcebbb062 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089376 Oct 19 13:43:12.951620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1334/2743] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:13.978218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:13.979243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:13.982076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:13.982249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:43:13.989556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:13.990036 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:13.990483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:13.991168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:13.991642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:13.992063 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:13.995624 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:14.054594 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:14.063978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-67a47915-9cf9-482d-96be-364f1246cfed tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092298 Oct 19 13:43:14.064534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1410/2744] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:15.090765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:15.091681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:15.095636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:15.095894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:43:15.106898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:15.107894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:15.108659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:15.110244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:15.110993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:15.111856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:15.188043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:15.196998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8489b8ea-1366-40d3-aca3-9191f5343321 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.113024 Oct 19 13:43:15.197553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1335/2745] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:16.223871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:16.224845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:16.233799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:16.234272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:16.235050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:16.235730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:16.236173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:16.236585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:16.305676 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:16.314622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a143306b-b7b9-49af-92b4-45328a143471 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097186 Oct 19 13:43:16.315200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1411/2746] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:17.344145 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:17.344759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:17.351390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:17.351865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:17.352291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:17.353009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:17.353454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:17.353870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:17.415130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:17.423998 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-41d9da8f-0f93-4d0a-a2c0-34ef8b1112f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.083807 Oct 19 13:43:17.424589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1336/2747] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:18.452855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:18.453659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:18.462532 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:18.463173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:18.463775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:18.464719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:18.465370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:18.465931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:18.533143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:18.541490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7a2883ef-6f7e-405a-9b98-5d677bba0ee0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094365 Oct 19 13:43:18.542051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1412/2748] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:18 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:19.568821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:19.569928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:19.580919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:19.581743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:19.582454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:19.583576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:19.584371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:19.585106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:19.670298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:19.679029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ff965aa2-b976-4639-a0cc-9c0f4e55ad71 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.116743 Oct 19 13:43:19.679598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1337/2749] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:19 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:20.707087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:20.708002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:20.718529 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:20.719389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:20.720122 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:20.721360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:20.722121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:20.722836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:20.789217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:20.797793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-22c6408e-4df4-4eff-9db1-1ab2af6a1845 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097676 Oct 19 13:43:20.798364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1413/2750] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:21.825028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:21.826012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:21.836810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:21.837651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:21.838375 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:21.839508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:21.840372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:21.841073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:21.904137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:21.917035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f1cc2f2e-a1a5-438c-bea8-9d5aaccae128 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098547 Oct 19 13:43:21.917842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1338/2751] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:21 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:22.939970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:22.940601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:22.947280 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:22.947762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:22.948194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:22.948890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:22.949341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:22.949757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:23.014064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:23.027229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c02bea6f-3e6c-452f-871f-c8211a4d0cad tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090901 Oct 19 13:43:23.027988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1414/2752] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:22 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:24.055491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:24.056485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:24.065346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:24.065823 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:24.066247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:24.066926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:24.067368 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:24.067781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:24.070310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:24.135056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:24.144115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-93f69be9-cb87-4d92-a941-10b0d8f7699e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095602 Oct 19 13:43:24.144660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1339/2753] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:24 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:25.171326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:25.171906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:25.179286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:25.179793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:25.180256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:25.181015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:25.181494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:25.181944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:25.247815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:25.256695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-81b65124-cd44-477d-932c-b0b0c77ab7f1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091882 Oct 19 13:43:25.257311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1415/2754] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:25 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:26.282665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:26.283502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:26.292318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:26.293025 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:26.293591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:26.294494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:26.295091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:26.295632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:26.364403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:26.377886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cb1e7d41-3d7d-42bc-8031-88a94900afe4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.101040 Oct 19 13:43:26.378693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1340/2755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:26 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:27.405970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:27.406986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:27.417975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:27.418780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:27.419505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:27.421121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:27.421566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:27.422012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:27.491248 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:27.502114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-279491ca-1660-4281-a84f-d816965ec82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103312 Oct 19 13:43:27.502679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1416/2756] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:27 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:28.527795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:28.528846 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:28.537223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:28.537706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:28.538135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:28.538821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:28.539268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:28.539683 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:28.617106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:28.627702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e7ca3e0a-0b19-429b-942d-e175089c207a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.106450 Oct 19 13:43:28.628578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1341/2757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:28 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:29.654995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:29.655869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:29.667143 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:29.668012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:29.668743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:29.670792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:29.670792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:29.671632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:29.735369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:29.743929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b3c22271-5eaf-4e4d-8af9-92097206395a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095615 Oct 19 13:43:29.744494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1417/2758] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:29 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:30.768680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:30.769593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:30.780132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:30.780856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:30.781540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:30.782209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:30.782641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:30.783079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:30.846827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:30.855621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4fcfbd57-65e9-47e4-bd19-2b3133ce607a tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092460 Oct 19 13:43:30.856170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1342/2759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:30 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:31.884513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:31.885525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:31.894550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:31.895056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:31.895495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:31.896183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:31.896636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:31.897065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:31.962207 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:31.971123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-559a64d0-b2fe-4b09-a55b-daad91123e2c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093185 Oct 19 13:43:31.972002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1418/2760] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:31 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:32.999539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:33.000562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:33.008146 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:33.008630 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:33.009104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:33.009779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:33.010244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:33.010661 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:33.076727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:33.085295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-51483c4d-c8ac-4151-865f-0e65ce85eb28 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092833 Oct 19 13:43:33.085886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1343/2761] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:32 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:34.111791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:34.112444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:34.114919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:34.120560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:34.121097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:34.121560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:34.122282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:34.122757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:34.123199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:34.186974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:34.196058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-513ea612-873b-44ed-ab54-f43989c228c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090997 Oct 19 13:43:34.196607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1419/2762] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:34 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:35.231379 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:35.232405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:35.236551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:43:35.236810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a (ip 10.222.0.17) !!! Oct 19 13:43:35.246827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:35.247649 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:35.248356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:35.249514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:35.250256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:35.250944 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:35.313334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:35.321715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a3379ca9-b75a-40ec-b48f-4ed727a699c1 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.096950 Oct 19 13:43:35.322241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1344/2763] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:35 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:36.344065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:36.344651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:36.351618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:36.352100 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:36.352538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:36.353257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:36.353702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:36.354121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:36.427912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:36.440721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-87a1b6cc-4fde-454a-bb4d-dfdcab1517e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100595 Oct 19 13:43:36.441338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1420/2764] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:36 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:37.467686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:37.468699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:37.476212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.476685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.477148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.477827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:37.478266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:37.478704 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:37.543865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:37.553023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e842166-64dc-4f7d-91b8-ccd17f6c78d4 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091766 Oct 19 13:43:37.553586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1345/2765] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:37 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:38.580120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:38.581121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:38.589191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:38.589760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:38.590271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:38.591086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:38.591617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:38.592112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:38.659973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:38.668275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3763fe47-1725-4c57-a8c3-3b5c7887f6ce tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094815 Oct 19 13:43:38.668908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1421/2766] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:38 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:39.703713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:39.704633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:39.708554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:39.717673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.718487 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.719154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.720259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:39.721113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:39.721550 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:39.791281 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:39.800022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-68e36021-d821-44bf-b55e-be5958ded0ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103223 Oct 19 13:43:39.800582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1346/2767] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:39 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:40.826738 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:40.827815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:40.835815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:40.836303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:40.836736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:40.837466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:40.837915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:40.838342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:40.903230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:40.913577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c584496d-8c2d-4baf-aed0-2f9c4bbad5d3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093328 Oct 19 13:43:40.914152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1422/2768] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:40 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:41.940425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:41.941130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:41.948735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:41.949327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:41.949777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:41.950538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:41.951032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:41.951499 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:42.016365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:42.025731 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-98459391-c8b7-45a4-977c-83d4ae16a169 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091751 Oct 19 13:43:42.026334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1347/2769] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:41 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:43.110522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:43.111609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:43.119547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:43.120058 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:43.120515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:43.121272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:43.121752 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:43.122197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:43.185923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:43.194628 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-23c6f58d-0a9a-4bf0-a95f-1c9b0f6175fe tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.090976 Oct 19 13:43:43.195198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1423/2770] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:43 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:44.221922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:44.222902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:44.230933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:44.231504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:44.232009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:44.232812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:44.233381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:44.233878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:44.300493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:44.309742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-47698851-c7c7-4168-be04-6f4548f8ee24 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094371 Oct 19 13:43:44.310314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1348/2771] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:44 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:45.332294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:45.332848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:45.339775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:45.340257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:45.340689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:45.341402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:45.341854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:45.342273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:45.344753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:45.419244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:45.431797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-91a74895-82ec-48fc-a0c8-ff1e842285cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103453 Oct 19 13:43:45.432533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1424/2772] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:45 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:46.460266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:46.461263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:46.472274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:46.472754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:46.473206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:46.473885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:46.474324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:46.474732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:46.539399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:46.547984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b1e7d6ed-3e67-48c7-849d-d3bf89509a34 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094666 Oct 19 13:43:46.548551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1349/2773] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:46 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:47.575072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:47.576031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:47.585169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:47.585653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:47.586088 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:47.586778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:47.587266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:47.587728 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:47.652389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:47.663675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bf64b512-a5d9-4f10-9b40-d77b421aff30 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095503 Oct 19 13:43:47.664252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1425/2774] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:47 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:48.690647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:48.691657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:48.698086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:48.698546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:48.698966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:48.699638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:48.700074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:48.700481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:48.763889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:48.772278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-efc7c29f-48c3-4134-bf6f-03f3fe608198 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.088678 Oct 19 13:43:48.772830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1350/2775] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:48 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:49.795240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:49.795817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:49.801929 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:49.802415 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:49.802881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:49.803571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:49.804042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:49.804461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:49.866090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:49.874571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-31f5b11a-a7ab-450e-8558-887809f4a5cb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.083379 Oct 19 13:43:49.875156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1426/2776] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:49 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:43:50.902570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:50.903572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:50.913536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:50.913895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:50.914422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:50.914993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:50.915451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:50.915857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:50.981686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:50.991920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7cac3d0a-6c7f-4e6c-b942-6f6c979db771 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095636 Oct 19 13:43:50.992397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1351/2777] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:50 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:52.019914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:52.020748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:52.027045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:52.027530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:52.027984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:52.028660 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:52.029142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:52.029565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:52.090793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:52.099282 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5d42e85a-728a-4e1e-8735-2e77e8f6abac tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.086581 Oct 19 13:43:52.099863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1427/2778] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:52 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:53.126460 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:53.127469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:53.136092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:53.136573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:53.137039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:53.137737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:53.138187 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:53.138608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:53.203817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:53.212573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c6406244-0afa-40d3-82f0-8597e4404506 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092778 Oct 19 13:43:53.213186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1352/2779] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:53 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:54.240521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:54.241188 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:54.248926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:54.249481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:54.249962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:54.250717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:54.251214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:54.251673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:54.326463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:54.335216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b16ecefc-b7fc-4909-bcb2-f31d5f3e7d31 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.101983 Oct 19 13:43:54.335776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1428/2780] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:54 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:55.358406 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:55.359339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:55.366582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:55.367086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:55.367518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:55.368201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:55.368654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:55.369104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:55.371690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=84 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:43:55.435337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:55.444055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d391b00d-2c3b-4ce5-b31e-4aeb0f30fe4b tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089334 Oct 19 13:43:55.444642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1353/2781] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:55 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:56.471331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:56.472284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:56.483327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:56.484519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:56.485279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:56.486403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:56.487137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:56.487845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:56.552554 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:56.563011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5f1dd3ba-c01f-47fe-a3b3-3d79480c8c01 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098198 Oct 19 13:43:56.563580 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1429/2782] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:56 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:57.590968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:57.591842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:57.602052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:57.602529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:57.602948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:57.603623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:57.604053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:57.604476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:57.667242 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:57.675928 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-378391ff-e901-4584-b65f-0eb4b8ed0e94 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091663 Oct 19 13:43:57.676485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1354/2783] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:57 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:58.703413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:58.704313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:58.713286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:58.713771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:58.714198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:58.714881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:58.715331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:58.715749 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:58.786131 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:58.795011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6a1bd3ad-dde4-4c9d-9ed9-591bd07d44b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.098525 Oct 19 13:43:58.795566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1430/2784] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:58 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:43:59.820592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:43:59.821220 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:43:59.828056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:59.828530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:59.828983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:59.829666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:43:59.830102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:43:59.830516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:43:59.898351 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:43:59.907014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fd9b5c69-51c3-4fa8-9768-f80c6ad10a40 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.091782 Oct 19 13:43:59.907553 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1355/2785] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:43:59 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:00.932384 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:00.933046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:00.939980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.940458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.940900 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:00.941600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:00.942066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:00.942469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:01.004789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:01.013271 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-47bd7aaf-de80-4a45-a9df-6d3aa479df3e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.085989 Oct 19 13:44:01.013829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1431/2786] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:00 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:02.036480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:02.037231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:02.044271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.044752 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.045209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.045897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:02.046343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:02.046755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:02.116595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:02.125331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d2f30127-51d3-44f1-9fb3-85840aade4ee tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.093262 Oct 19 13:44:02.125910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1356/2787] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:02 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:03.151429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:03.152123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:03.160470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.161116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.161621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.162508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:03.163074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:03.163599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:03.232272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:03.245763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-df681b9f-2c44-4084-9ffa-6894e0816cf8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.099924 Oct 19 13:44:03.246551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1432/2788] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:03 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:04.277273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:04.278291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:04.289361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.289845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.290274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.290964 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:04.291439 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:04.291853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:04.354471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:04.366230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-967815bf-166e-4917-b376-6001509b7dc9 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095488 Oct 19 13:44:04.367091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1357/2789] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:04 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:05.393887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:05.394902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:05.398619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=28 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:05.404059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:05.404540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:05.405006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:05.405700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:05.406156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:05.406583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:05.702498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:05.715687 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d7f5d9e1-392f-4224-ad3b-70a52e4900db tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.328261 Oct 19 13:44:05.716474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1433/2790] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:05 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:06.745221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:06.745902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:06.753461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:06.753985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:06.754453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:06.755204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:06.755690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:06.756148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:06.821129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:06.829402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-03be820c-f381-4405-b0c7-ee3b80abf4f6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.089523 Oct 19 13:44:06.829972 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1358/2791] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:06 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:07.856212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:07.857306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:07.869045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:07.869826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:07.870672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:07.871825 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:07.872589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:07.873446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:07.938975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:07.947413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1c64e32c-eb92-4e1d-9845-f838115d7b17 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.097804 Oct 19 13:44:07.947977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1434/2792] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:07 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:08.973658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:08.974584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:08.985479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:08.986214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:08.986878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:08.987932 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:08.988626 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:08.989317 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:09.067770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:09.076507 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eeb32672-8b70-4fbd-8bb3-e0cadaf4068c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.108895 Oct 19 13:44:09.077116 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1359/2793] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:08 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:10.103151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:10.103879 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:10.112291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:10.112903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:10.113413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:10.114225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:10.114755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:10.115254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:10.180047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:10.188785 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-302b9397-c696-4b88-8864-06f213355657 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.092117 Oct 19 13:44:10.189370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1435/2794] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:10 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:11.215280 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:11.216012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:11.219098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=28 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:11.226378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:11.227009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:11.227669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:11.228733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:11.229402 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:11.230144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:11.295526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:11.304229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-15d1c31b-6543-41ab-9358-713ebf34e4ae tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.095026 Oct 19 13:44:11.304791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1360/2795] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:11 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:12.327832 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:12.328455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:12.335411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:12.335898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:12.336332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:12.337369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:12.337848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:12.338277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:12.406943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:12.418506 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-64db447d-fc44-46e9-94ef-83d6c867b432 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094683 Oct 19 13:44:12.419072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1436/2796] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:12 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:13.445658 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:13.446736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:13.457801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:13.458593 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:13.459288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:13.460421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:13.461211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:13.461908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:13.535618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:13.544427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2a609619-6546-4802-9e34-ebc2f5e40651 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.105219 Oct 19 13:44:13.545022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1361/2797] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:13 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:14.571509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:14.572241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:14.580908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:14.581533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:14.582078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:14.582928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:14.583491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:14.584050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:14.657657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:14.668702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2f7461a2-e5d9-43fb-81a5-98ff76831888 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.103924 Oct 19 13:44:14.669273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1437/2798] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:14 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:15.695959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:15.697316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:15.707568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:15.708494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:15.709247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:15.710370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:15.711136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:15.711858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:15.775069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:15.783557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9db44cf9-dc99-4e91-9201-92829cd0993c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.094276 Oct 19 13:44:15.784120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1362/2799] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:15 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:16.807113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:16.807688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:16.814482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.814988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.815410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.816112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:16.816575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:16.817032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:16.820978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=84 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:16.879382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:16.888249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2c6e827a-6c81-45eb-b314-390484e889e3 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.085175 Oct 19 13:44:16.888877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1438/2800] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:16 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:17.915824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:17.916822 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:17.927293 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:17.928081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:17.928787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:17.930011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:17.930677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:17.931143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:17.997195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:18.009871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c102ceb0-c742-45c0-881a-5dbd7d494f85 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 200 len: 1369 microversion: 2.1 time: 0.100501 Oct 19 13:44:18.010654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1363/2801] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:17 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:18.032821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-0fa75a06-c06b-4820-9e30-5a7293078b98 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '.version_select at 0x7ff4f95543a0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:18.037347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0fa75a06-c06b-4820-9e30-5a7293078b98 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [3da70507-ea55-4498-a575-882e3d606eb7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:44:19.046959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [None req-0fa75a06-c06b-4820-9e30-5a7293078b98 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [3da70507-ea55-4498-a575-882e3d606eb7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33710. Oct 19 13:44:19.075640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-0fa75a06-c06b-4820-9e30-5a7293078b98 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754313209" status: 202 len: 0 microversion: 2.1 time: 1.046683 Oct 19 13:44:19.076229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1439/2802] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Oct 19 13:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754313209 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:44:19.921551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6b35fcd0-e128-4a12-b40d-0a90cedd98eb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'create', calling method: .version_select at 0x7ff4f91ba790>, body: {"keypair": {"name": "tempest-keypair-1448148663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLukUo4uv64+0Vb2piNbQleFbl2Ii4CODr/fxkMP8SamBBVXaHhGGzWpjU1f4vMhmQWUKVucbspWv1d/Ow8PxJd78yASo+M4XwWWS18Fk4Tpsgg/UHVA7qk4Hfu/qidCew=="}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:19.940344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6b35fcd0-e128-4a12-b40d-0a90cedd98eb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for project f1e961b210664d81ab76acffd94b70d7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:44:19.945388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6b35fcd0-e128-4a12-b40d-0a90cedd98eb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for user ab18c81a3b6a4db98b3007c620950aef and project f1e961b210664d81ab76acffd94b70d7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:44:19.977219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6b35fcd0-e128-4a12-b40d-0a90cedd98eb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059291 Oct 19 13:44:19.978484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1364/2803] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:44:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:21.215313 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-17920050", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a057f69b-0e96-4372-ae51-a9f01790a7c2"}], "security_groups": [{"name": "tempest-securitygroup--1778479706"}], "key_name": "tempest-keypair-1448148663", "user_data": "}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:21.339747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] validate_networks() for [('a057f69b-0e96-4372-ae51-a9f01790a7c2', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:44:21.831358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:44:21.831804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:44:21.832272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:44:21.832697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:44:21.833137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:44:21.843040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:21.843516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:21.843938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:21.844651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:21.845133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:21.845549 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:21.864276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for project f1e961b210664d81ab76acffd94b70d7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:44:21.868364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Getting quotas for user ab18c81a3b6a4db98b3007c620950aef and project f1e961b210664d81ab76acffd94b70d7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:44:21.880409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:44:21.882704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:44:21.933107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bc759293-bd87-4040-bb58-1d4e172181cd tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725645 Oct 19 13:44:21.933745 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1440/2804] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:44:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:44:21.945660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f7deb0f9-575a-4d6d-b7dc-5204b9299267 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:21.946410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f7deb0f9-575a-4d6d-b7dc-5204b9299267 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:22.003441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f7deb0f9-575a-4d6d-b7dc-5204b9299267 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:22.010573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f7deb0f9-575a-4d6d-b7dc-5204b9299267 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1236 microversion: 2.1 time: 0.069663 Oct 19 13:44:22.021131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1365/2805] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:21 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:23.039209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:23.040116 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:23.047771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:23.048260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:23.048697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:23.049441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:23.049899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:23.050323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:23.116642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:23.125461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e4f023fc-fbcb-4673-930e-19f0d41be82c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1288 microversion: 2.1 time: 0.093385 Oct 19 13:44:23.129584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1441/2806] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:23 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:24.149612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:24.150298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:24.157221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:24.157695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:24.158115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:24.158808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:24.159225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:24.159636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:24.348609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:24.356577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6accbe6f-9c01-43c7-aa96-6504d036f8c0 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.211070 Oct 19 13:44:24.357201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1366/2807] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:24 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:24.778767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e7d141-1711-4643-b6cb-77483776c98c", "tag": "56b4572c-4cf2-4506-8ae2-ffa915f79f47"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:24.788741 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:24.789307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:24.789811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:24.801013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] Creating event network-changed:56b4572c-4cf2-4506-8ae2-ffa915f79f47 for instance d9e7d141-1711-4643-b6cb-77483776c98c on hv-cinder-maste Oct 19 13:44:24.808037 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-573217fa-c1b8-480e-981c-5e600874bd2f req-87694024-d5ae-47b0-947a-d579de617952 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156173 Oct 19 13:44:24.809196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1442/2808] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:25.382504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:25.383314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:25.392920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.393631 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.394254 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.395236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:25.395899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:25.396481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:25.400343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=72 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:25.535464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:25.547554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-49c59ad7-f4da-4b65-b674-b374554567e8 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.170505 Oct 19 13:44:25.548334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1367/2809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:25 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:26.578753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:26.579897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:26.591098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:26.591889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:26.592613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:26.593829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:26.594582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:26.595275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:26.825792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:26.833937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3284de42-036f-4c94-a1e3-792617707b96 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.262248 Oct 19 13:44:26.834419 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1443/2810] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:26 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:27.860327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:27.861404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:27.871456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:27.871931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:27.872352 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:27.873065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:27.873508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:27.873914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:28.006475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:28.014678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-89bd3a59-c2b5-45cf-af97-8b97a3562722 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.161414 Oct 19 13:44:28.015248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1368/2811] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:27 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:29.036602 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:29.037270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:29.046046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:29.046610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:29.047187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:29.048060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:29.048505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:29.049137 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:29.134692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e7d141-1711-4643-b6cb-77483776c98c", "name": "network-vif-plugged", "status": "completed", "tag": "56b4572c-4cf2-4506-8ae2-ffa915f79f47"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:29.144201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:29.144662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:29.145104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:29.156530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] Creating event network-vif-plugged:56b4572c-4cf2-4506-8ae2-ffa915f79f47 for instance d9e7d141-1711-4643-b6cb-77483776c98c on hv-cinder-maste Oct 19 13:44:29.163711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-810f8331-5601-47d7-9def-2cedf3d182e9 req-424a4034-8a96-4817-b5c7-4a23708d6b32 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127601 Oct 19 13:44:29.164381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1369/2812] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:44:29.190460 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:29.198427 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d6bcc145-e4ad-46ba-a0ea-06437e1b912c tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.165817 Oct 19 13:44:29.199007 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1444/2813] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:29 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:30.222086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:30.222771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:30.230511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:30.230983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:30.231400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:30.232349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:30.233224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:30.233688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:30.385290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:30.394224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-216cd539-9a26-4084-86eb-69cce78466af tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1362 microversion: 2.1 time: 0.176484 Oct 19 13:44:30.394790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1370/2814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:30 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:31.421072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:31.421826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:31.430004 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.430570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.431079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.431987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.433032 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.433533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.570368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:31.579254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-673a7101-73d3-4ca5-be7e-a04163ab133e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1549 microversion: 2.1 time: 0.163897 Oct 19 13:44:31.579792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1445/2815] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:44:31 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:44:31.604107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:31.604663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:31.611858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.612342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.612754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.613496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:31.613945 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:31.614361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:31.699019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f2f7216e-e32a-400a-a16b-f29c0cbe8553 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100935 Oct 19 13:44:31.699676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1371/2816] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:44:31 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:32.894688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e7d141-1711-4643-b6cb-77483776c98c", "tag": "56b4572c-4cf2-4506-8ae2-ffa915f79f47"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:32.899805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:32.900796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:32.908520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:32.909265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:32.909859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:32.921234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] Creating event network-changed:56b4572c-4cf2-4506-8ae2-ffa915f79f47 for instance d9e7d141-1711-4643-b6cb-77483776c98c on hv-cinder-maste Oct 19 13:44:32.926464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-e8159cdf-cd2c-4790-8573-6ef22354c96f req-50cd3102-115b-4af1-a596-6c06c8702194 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035872 Oct 19 13:44:32.927257 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1446/2817] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:56.066364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=6 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:56.068104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:56.068825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=23 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:56.072761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:56.073269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:56.081342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:56.081808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:56.082228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:56.082903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:56.083342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:56.083750 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:56.110176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:44:56.189831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-020adf4c-f6f8-446e-b5ad-d6d7e4a503c9 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 204 len: 0 microversion: 2.20 time: 0.123920 Oct 19 13:44:56.190513 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1372/2818] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Oct 19 13:44:56 2022] DELETE /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 13:44:56.199695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:56.200399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:56.202956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:56.203700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=35 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:44:56.210672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:56.211126 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:56.211561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:56.212254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:56.212693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:56.213145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:56.354698 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:56.363925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:56.365407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:56.366610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3f4f5c7f-5fbf-4131-acd7-0737fe2b1319 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1723 microversion: 2.20 time: 0.171459 Oct 19 13:44:56.367182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1447/2819] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:56 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:57.392692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:57.393479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:57.399982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:57.400454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:57.400891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:57.401583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:57.402022 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:57.402620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:57.485494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:57.494381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:57.495781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e6d95493f8e4b58a9a212999916e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a5888bfc20042a791f6798975b860fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:44:57.496966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ca045bdd-579b-4adc-98d3-d00219b3cf58 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 200 len: 1655 microversion: 2.20 time: 0.108616 Oct 19 13:44:57.509424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1373/2820] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:57 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 1655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 13:44:57.520629 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320026c6-9bba-465d-9022-c32b670f3a9b", "name": "network-vif-deleted", "tag": "ba5db0e0-3d72-43e4-b5c4-2942be7db45d"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:44:57.531932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:57.532417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:57.532842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:57.550496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] Creating event network-vif-deleted:ba5db0e0-3d72-43e4-b5c4-2942be7db45d for instance 320026c6-9bba-465d-9022-c32b670f3a9b on hv-cinder-maste Oct 19 13:44:57.560172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-29f352ac-ab32-40a9-844d-3191e7764e11 req-629b582a-5a40-438f-9e4a-8a85e3f8f30e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044078 Oct 19 13:44:57.561961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1448/2821] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:44:58.530940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:58.531568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:44:58.538421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:58.538902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:58.539328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:58.540010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:44:58.540455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:44:58.540882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:44:58.557572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] HTTP exception thrown: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Request method failure captured: Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b HTTP/1.1 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_gzO5MD7vOdQBW2spKKLnta8r4RLviGDeJgaE_gWoklIRtDgQbxnMAmvcY_ulW2FZC29cWoczq6VjpCAUBj-WFVKD8lb_srb6JB8Wm5w8sbCGoXSfRGHQo2_whpgejYyoBQBhU4eu_5MgiXOZAvfwhr1zQBFIZhw8MGc8irvenWGsA Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:44:58.559524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a5888bfc20042a791f6798975b860fd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 7e6d95493f8e4b58a9a212999916e6b1 Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:44:58.561415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '320026c6-9bba-465d-9022-c32b670f3a9b'} Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:44:58.562347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:44:58.563847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:44:58.565258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Returning 404 to user: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:44:58.565258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-97cba270-bf23-4021-913b-6baacbac9d88 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 404 len: 111 microversion: 2.20 time: 0.035196 Oct 19 13:44:58.565258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1374/2822] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:44:58 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:44:58.570399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-17028eb3-522a-41c6-98ae-b95451be4a0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '.version_select at 0x7ff4f91edf70>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:44:58.592561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-17028eb3-522a-41c6-98ae-b95451be4a0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430762613" status: 204 len: 0 microversion: 2.20 time: 0.026301 Oct 19 13:44:58.593213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1449/2823] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Oct 19 13:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430762613 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 13:45:09.308920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:45:09.309535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:45:09.312232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:09.312898 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:45:09.318341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:09.318827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:09.319252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:09.319942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:45:09.320384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:45:09.320795 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:45:09.346441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2c344157-93ec-4a6d-9961-e7290b343459 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c/ips" status: 200 len: 147 microversion: 2.1 time: 0.041463 Oct 19 13:45:09.346989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1375/2824] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:45:09 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:09.425967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=8 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:09.427215 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:09.433936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:09.434910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:09.443474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.443948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.444379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.445094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.445528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.445946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.472488 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:46:09.557166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-20bf2eae-a832-4e0a-a0fd-b36f77c164b6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 204 len: 0 microversion: 2.1 time: 0.134356 Oct 19 13:46:09.557746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1450/2825] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:46:09 2022] DELETE /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:46:09.564743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:46:09.568922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:09.569475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:09.575608 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.576080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.576505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.577213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:09.577654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:09.578106 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:09.768724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:09.780737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4a7eca9c-9432-4dbc-b9d3-862e01916bc7 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1674 microversion: 2.1 time: 0.218018 Oct 19 13:46:09.781857 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1376/2826] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:09 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:10.810256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:10.811394 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:10.822150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:10.822953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:10.823715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:10.824844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:10.825631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:10.826331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:10.960570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:10.968516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-027fab93-3de5-4b31-814b-41647e9161de tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1674 microversion: 2.1 time: 0.165362 Oct 19 13:46:10.969162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1451/2827] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:10 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:11.938920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e7d141-1711-4643-b6cb-77483776c98c", "name": "network-vif-deleted", "tag": "56b4572c-4cf2-4506-8ae2-ffa915f79f47"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:46:11.950363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:11.950841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:11.951275 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:11.963515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] Creating event network-vif-deleted:56b4572c-4cf2-4506-8ae2-ffa915f79f47 for instance d9e7d141-1711-4643-b6cb-77483776c98c on hv-cinder-maste Oct 19 13:46:11.969318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-fb186533-9eac-4f45-9459-ac03c009311f req-3e72b621-d17c-46f5-b888-dbbff4ab3ab1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033940 Oct 19 13:46:11.970231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1377/2828] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:46:11.991766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:11.992501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:12.006440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:12.007492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:12.008167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:12.009140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:12.009828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:12.010466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:12.079078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab18c81a3b6a4db98b3007c620950aef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1e961b210664d81ab76acffd94b70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:46:12.089424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-879ecd70-223c-4cb2-82a2-0cdf9f7faceb tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 200 len: 1321 microversion: 2.1 time: 0.101463 Oct 19 13:46:12.090192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1452/2829] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:11 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:46:13.114831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:13.115531 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:13.122295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.122773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.123202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.123888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.124330 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.124816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.139043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] HTTP exception thrown: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Request method failure captured: Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c HTTP/1.1 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_iNhFx5h8z5sLVX25j5wWT-zJbqYslNjTl6886nMj6MxFsrnLUxYy29awTE39dGFBeDMX9SvpupEk6Md6-MLxfo3nXIkqxn8UsZ-Cn8uNM2w4BhDXLbi7ZFTmif0eHcObvPh_w7nS6-eL-RaVkV3_SpmVokWfFKCVO5hTWIi9kMoQo Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:46:13.140801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1e961b210664d81ab76acffd94b70d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ab18c81a3b6a4db98b3007c620950aef Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.142692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'd9e7d141-1711-4643-b6cb-77483776c98c'} Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:46:13.143809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.145560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.147178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Returning 404 to user: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:46:13.147178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9691a9f9-6813-4676-802e-fe60e50d4fd6 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 404 len: 111 microversion: 2.1 time: 0.032168 Oct 19 13:46:13.147178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1378/2830] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:13 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:46:13.151451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f7809b67-2662-47bb-b2d6-06cd489eb958 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '.version_select at 0x7ff4f903a4c0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:13.174326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f7809b67-2662-47bb-b2d6-06cd489eb958 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448148663" status: 202 len: 0 microversion: 2.1 time: 0.026848 Oct 19 13:46:13.174884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1453/2831] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Oct 19 13:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1448148663 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:46:13.811104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:13.811602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:13.818004 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.818484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.818911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.819588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.820033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.820450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.834924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] HTTP exception thrown: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Request method failure captured: Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: DELETE /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c HTTP/1.1 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_iNhFx5h8z5sLVX25j5wWT-zJbqYslNjTl6886nMj6MxFsrnLUxYy29awTE39dGFBeDMX9SvpupEk6Md6-MLxfo3nXIkqxn8UsZ-Cn8uNM2w4BhDXLbi7ZFTmif0eHcObvPh_w7nS6-eL-RaVkV3_SpmVokWfFKCVO5hTWIi9kMoQo Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:46:13.836473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1e961b210664d81ab76acffd94b70d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ab18c81a3b6a4db98b3007c620950aef Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.838259 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'd9e7d141-1711-4643-b6cb-77483776c98c'} Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:46:13.839260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.840920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.842646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Returning 404 to user: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:46:13.842646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dfc4e456-4df0-40ca-876b-85c8c5f2134e tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 404 len: 111 microversion: 2.1 time: 0.030768 Oct 19 13:46:13.842646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1379/2832] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:46:13 2022] DELETE /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:46:13.847437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:46:13.848086 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: d9e7d141-1711-4643-b6cb-77483776c98c] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:46:13.854950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.855794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.856238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.856931 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:46:13.857410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:46:13.857836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:46:13.871705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] HTTP exception thrown: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Request method failure captured: Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c HTTP/1.1 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_iNhFx5h8z5sLVX25j5wWT-zJbqYslNjTl6886nMj6MxFsrnLUxYy29awTE39dGFBeDMX9SvpupEk6Md6-MLxfo3nXIkqxn8UsZ-Cn8uNM2w4BhDXLbi7ZFTmif0eHcObvPh_w7nS6-eL-RaVkV3_SpmVokWfFKCVO5hTWIi9kMoQo Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:46:13.873386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1e961b210664d81ab76acffd94b70d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: ab18c81a3b6a4db98b3007c620950aef Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.875457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'd9e7d141-1711-4643-b6cb-77483776c98c'} Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:46:13.876396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. Oct 19 13:46:13.878206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:46:13.879686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Returning 404 to user: Instance d9e7d141-1711-4643-b6cb-77483776c98c could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:46:13.879686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-176654f7-143a-44e9-b901-703616cacc87 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c" status: 404 len: 111 microversion: 2.1 time: 0.031875 Oct 19 13:46:13.879686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1454/2833] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:46:13 2022] GET /compute/v2.1/servers/d9e7d141-1711-4643-b6cb-77483776c98c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:48:24.918508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=8 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:24.919255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=16 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:24.920017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:48:24.920179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 13:48:24.921210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:48:24.921326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 13:48:24.926370 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1de460a-d49c-4426-b831-aea60f28e9aa", "name": "network-vif-deleted", "tag": "c4155421-8ec4-4ae0-beed-d2f66efefb43"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:24.939699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:24.940165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:24.940582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:24.951873 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] Creating event network-vif-deleted:c4155421-8ec4-4ae0-beed-d2f66efefb43 for instance e1de460a-d49c-4426-b831-aea60f28e9aa on hv-cinder-maste Oct 19 13:48:24.957081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-6b2d4e47-5356-4571-b45a-9881c7e3277e req-cc6f9cda-1847-4886-81f9-10d4bfad4be1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Oct 19 13:48:24.957753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1380/2834] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:48:26.971142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b57fe2dc-35a6-4afd-92e9-314baf7ea7a6] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 13:48:26.974887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb468a8-83a3-4574-859c-72e04d9ab535", "name": "network-vif-deleted", "tag": "c1093210-0052-44af-8f5b-e5f8af5f570b"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:26.980434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:26.981046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:26.982372 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 13:48:26.982679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 13:48:26.984850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 13:48:26.985243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 13:48:27.005283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:48:27.005283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:48:27.005283 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:48:27.018144 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] Creating event network-vif-deleted:c1093210-0052-44af-8f5b-e5f8af5f570b for instance 0bb468a8-83a3-4574-859c-72e04d9ab535 on hv-cinder-maste Oct 19 13:48:27.025831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-fd7a4827-36ee-4457-9223-ac4a892d247d req-2fe27334-7636-4982-8af2-15fd48ede947 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057111 Oct 19 13:48:27.027117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1455/2835] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:48:57.815514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24f42617-d8d0-4ded-8970-29f16cb25b83] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:48:57.816277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:57.816802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:48:58.008668 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0c8bbba4-1115-4a70-9f0a-b3e8f2651abe tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Action: 'create', calling method: .version_select at 0x7ff4fc9c7af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-694965556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDO5ZkPE9KCvhjUxp7TGRUy5oNZlwRveJIX2Wnl0ZlKLAOz1olOZq1cjgvU0SLG7hjip6VWArtcU7eUw7QCKbeYP0upSTLGfHUJhDM3DMwnch/kCuTbuYCRpT3YibIiyQ=="}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:48:58.030554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-0c8bbba4-1115-4a70-9f0a-b3e8f2651abe tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:48:58.035648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-0c8bbba4-1115-4a70-9f0a-b3e8f2651abe tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for user ad89cdd33ea645d8948465fe0c88a695 and project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:48:58.066596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0c8bbba4-1115-4a70-9f0a-b3e8f2651abe tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.252793 Oct 19 13:48:58.067522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1381/2836] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:48:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:16.918904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:16.919701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:16.923795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-799210432", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694965556", "security_groups": [{"name": "tempest-secgroup-smoke-880256063"}], "block_device_mapping_v2": [{"uuid": "f544bfff-0ada-4748-8206-8e0e368e6b73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa3e645-46a5-47f6-8f05-46de41db5195"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:16.948444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] [b57fe2dc-35a6-4afd-92e9-314baf7ea7a6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34936. Oct 19 13:49:17.042281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] validate_networks() for [('3aa3e645-46a5-47f6-8f05-46de41db5195', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:49:17.440373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:49:17.440951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:49:17.441434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:49:17.441930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:49:17.442399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:49:17.451272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:17.451816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:17.452331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:17.453141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:17.453659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:17.454149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:17.471269 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:49:17.475334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for user ad89cdd33ea645d8948465fe0c88a695 and project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:49:17.536344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:49:17.538622 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f544bfff-0ada-4748-8206-8e0e368e6b73',volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:49:17.677206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [b436629a-366c-4fa5-a529-9fc6c58dd1f9] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:49:18.686052 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [b436629a-366c-4fa5-a529-9fc6c58dd1f9] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34986. Oct 19 13:49:18.690658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e3192243-a15d-4268-b154-c74dec6dfd03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.773449 Oct 19 13:49:18.691530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1456/2837] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:49:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:49:18.700294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=4 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:18.701516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:18.706248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ad4cf39b-ee19-4dff-8b77-b65d42eb31e6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:18.706979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ad4cf39b-ee19-4dff-8b77-b65d42eb31e6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:18.720202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] [24f42617-d8d0-4ded-8970-29f16cb25b83] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34990. Oct 19 13:49:18.765540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ad4cf39b-ee19-4dff-8b77-b65d42eb31e6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:18.772584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ad4cf39b-ee19-4dff-8b77-b65d42eb31e6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1093 microversion: 2.1 time: 0.073775 Oct 19 13:49:18.773176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1382/2838] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:18 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:19.795377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f0fa5167-1b95-491c-90ef-5a85680033a5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:19.795971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f0fa5167-1b95-491c-90ef-5a85680033a5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:19.850776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f0fa5167-1b95-491c-90ef-5a85680033a5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:19.860509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f0fa5167-1b95-491c-90ef-5a85680033a5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1093 microversion: 2.1 time: 0.069632 Oct 19 13:49:19.861145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1457/2839] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:19 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:20.887604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-95737a1f-144e-4060-8bea-c993899d807b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:20.888393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-95737a1f-144e-4060-8bea-c993899d807b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:20.945646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-95737a1f-144e-4060-8bea-c993899d807b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:20.953592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-95737a1f-144e-4060-8bea-c993899d807b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1093 microversion: 2.1 time: 0.069730 Oct 19 13:49:20.954343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1383/2840] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:20 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:21.976991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d8700add-d6bb-4e07-8cb5-a97f957fedad tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:21.977675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d8700add-d6bb-4e07-8cb5-a97f957fedad tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:22.034519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d8700add-d6bb-4e07-8cb5-a97f957fedad tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:22.043462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d8700add-d6bb-4e07-8cb5-a97f957fedad tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1093 microversion: 2.1 time: 0.070809 Oct 19 13:49:22.058960 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1458/2841] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:21 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:23.066893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:23.067485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:23.075318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:23.075789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:23.076218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:23.077216 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:23.077347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:23.077754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:23.143179 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:23.158206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ccefe2c0-ec77-46d0-9a25-d3f5d9ad837d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1143 microversion: 2.1 time: 0.095506 Oct 19 13:49:23.158844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1384/2842] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:23 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:24.182117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:24.182791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:24.190051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:24.190366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:24.191022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:24.191725 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:24.192338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:24.192674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:24.262591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:24.270806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-65fb26ab-f759-4e73-bbe2-607302ca5338 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1209 microversion: 2.1 time: 0.092505 Oct 19 13:49:24.277171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1459/2843] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:24 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:24.716990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-949483428", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:24.781002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] validate_networks() for None {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:49:25.192592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:49:25.193049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:49:25.193765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:49:25.194031 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:49:25.194773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:49:25.204396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:25.204977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:25.205471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:25.206190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:25.206632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:25.207044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:25.224753 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Getting quotas for project 18d5b512604844cb828b3d0d93319c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:49:25.229394 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Getting quotas for user 38ae8e5e13c642fbb9b009cfd52854a9 and project 18d5b512604844cb828b3d0d93319c1c. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:49:25.242199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:49:25.244570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:49:25.292302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6d99ce53-7bb0-494d-8709-1cd97e6e5523 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579128 Oct 19 13:49:25.292969 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1385/2844] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:49:25.304678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-91b89da0-d27f-404d-9d13-584f49d7b5b4 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:25.305371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-91b89da0-d27f-404d-9d13-584f49d7b5b4 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:25.306674 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:25.307402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:25.317299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:25.317750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:25.325352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:25.326364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:25.326836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:25.327267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:25.371329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-91b89da0-d27f-404d-9d13-584f49d7b5b4 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:25.386797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-91b89da0-d27f-404d-9d13-584f49d7b5b4 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1214 microversion: 2.1 time: 0.085559 Oct 19 13:49:25.387691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1386/2845] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:25 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:25.502727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:25.514455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-632e1db2-c714-4d41-b6e7-a45716a8e64a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.222403 Oct 19 13:49:25.515888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1460/2846] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:25 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:25.614908 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fb78bd-9228-4d86-bd9c-a35cccc53e81", "tag": "0db9f681-a433-4fca-acbf-bb14406e6a8b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:25.624952 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:25.625554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:25.625981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:25.639409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] Creating event network-changed:0db9f681-a433-4fca-acbf-bb14406e6a8b for instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 on hv-cinder-maste Oct 19 13:49:25.644798 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-fc1db0a7-e437-4b7e-b0b7-1a7f937a61ba req-c57f1af7-7e88-4f66-8374-d470aadff502 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184232 Oct 19 13:49:25.645943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1387/2847] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:49:26.411145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:26.411812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:26.418915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:26.419782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:26.420235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:26.420916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:26.421555 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:26.421975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:26.483227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:26.491267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d7fca68b-74b7-4685-b9c1-ecda46a96478 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1266 microversion: 2.1 time: 0.084122 Oct 19 13:49:26.491847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1461/2848] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:26 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:26.540441 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:26.541183 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:26.547693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:26.548221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:26.548652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:26.549373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:26.549852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:26.550273 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:26.793230 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:26.803162 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c54293bd-71bb-492c-8f94-ceffd6731539 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.267443 Oct 19 13:49:26.817831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1388/2849] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:26 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:27.517716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:27.518356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:27.520678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:27.525971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:27.526504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:27.527008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:27.527756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:27.528220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:27.528633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:27.827974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:27.828831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:27.836912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:27.837496 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:27.838008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:27.838764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:27.839261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:27.839743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:27.862901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:27.872335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-44afa9d9-e9ed-48d5-9fae-b7914449bd71 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.358548 Oct 19 13:49:27.875920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1462/2850] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:27 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:27.994597 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:28.006361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7890d685-cd67-441b-944a-eaa82547f8ff tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.182265 Oct 19 13:49:28.006919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1389/2851] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:27 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:28.470603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2098f5b5-8b1e-4190-9000-5c0af3c96126", "tag": "c8ed56ef-2e64-4e50-9fbb-12acc992af85"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:28.480446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:28.480951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:28.481379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:28.493198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] Creating event network-changed:c8ed56ef-2e64-4e50-9fbb-12acc992af85 for instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 on hv-cinder-maste Oct 19 13:49:28.498434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-fcc647c2-8d48-4bd7-8691-10c995d2bfc0 req-cb865dff-fcda-4c09-8d74-235826b8cef0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093564 Oct 19 13:49:28.499292 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1463/2852] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:28.900219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:28.900832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:28.908161 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:28.908638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:28.909118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:28.909816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:28.910261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:28.910681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:29.030395 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:29.031740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:29.038219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:29.038801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:29.039237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:29.039923 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:29.040367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:29.040783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:29.049278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:29.057057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c5134ce0-bbb6-4c63-baad-17f663346eb0 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.160760 Oct 19 13:49:29.057700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1390/2853] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:28 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:29.177722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:29.189663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ae647593-38f9-4238-abb4-0e3e795d80a2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.163985 Oct 19 13:49:29.190469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1464/2854] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:29 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:30.080231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:30.080975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:30.087980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.088454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.088895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.089590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.090030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.090442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.218166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:30.218870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:30.226410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.226976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.227411 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.228098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:30.228540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:30.228988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:30.233403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:30.241807 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b3977a41-3ebf-48a8-bd8f-1aae41ae827f tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.166013 Oct 19 13:49:30.242374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1391/2855] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:30 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:30.365216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:30.376513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75ea5606-f1a6-469e-b2f6-131d9f021c24 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.161994 Oct 19 13:49:30.377217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1465/2856] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:30 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:31.264291 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:31.265037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:31.272054 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:31.272607 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:31.273137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:31.273891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:31.274436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:31.274912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:31.399324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:31.399997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:31.405128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:31.406578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:31.407065 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:31.407500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:31.408191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:31.408686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:31.409155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:31.412764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-82e08303-9983-4c21-9796-3fc9db2fcf5e tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.152477 Oct 19 13:49:31.413422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1392/2857] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:31 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:31.535875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:31.543711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d46200b2-7302-43b2-966a-164d4acf382e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.148324 Oct 19 13:49:31.544290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1466/2858] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:31 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:32.440083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:32.441099 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:32.448272 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:32.448764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:32.449253 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:32.449968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:32.450435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:32.450878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:32.567216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:32.567828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:32.569871 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=10 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:32.576025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:32.576514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:32.576950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:32.577679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:32.578134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:32.578559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:32.587562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:32.595214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b7a27da-f40d-4e75-be87-d520ef43aabe tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.161933 Oct 19 13:49:32.595779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1393/2859] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:32 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:32.714956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:32.723414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f04fa711-503b-4c02-b6a0-ee67022d7282 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.160342 Oct 19 13:49:32.723984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1467/2860] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:32 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:33.127533 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2098f5b5-8b1e-4190-9000-5c0af3c96126", "name": "network-vif-plugged", "status": "completed", "tag": "c8ed56ef-2e64-4e50-9fbb-12acc992af85"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:33.137560 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:33.138032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:33.138589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:33.150884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] Creating event network-vif-plugged:c8ed56ef-2e64-4e50-9fbb-12acc992af85 for instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 on hv-cinder-maste Oct 19 13:49:33.156047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-8c5030b0-32dc-4a31-bce5-e3efb05fc0c9 req-bdb5091e-8aa9-4527-be13-3c59c39caa16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089186 Oct 19 13:49:33.156979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1394/2861] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:33.622768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:33.623424 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:33.634170 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:33.634845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:33.635474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:33.636517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:33.637099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:33.637601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:33.748425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:33.749296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:33.762948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:33.762948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:33.762948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:33.762948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:33.763497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:33.763497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:33.790412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:33.797619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-79e4dba3-43fc-48e6-aa88-eda05093b5cb tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1314 microversion: 2.1 time: 0.180515 Oct 19 13:49:33.798083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1468/2862] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:33 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:33.912878 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:33.925609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3c32f8c4-890c-4e6d-9e35-29ec8221e0ce tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.182058 Oct 19 13:49:33.926182 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1395/2863] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:33 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:34.821872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:34.822500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:34.829218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:34.829734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:34.830150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:34.830846 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:34.831298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:34.831724 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:34.951239 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:34.951863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:34.958825 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:34.959600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:34.960264 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:34.961040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:34.961470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:34.962081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:34.967996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:34.977365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-484895b6-189f-4602-ba84-ccd6a08e8a76 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1463 microversion: 2.1 time: 0.159641 Oct 19 13:49:34.978035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1469/2864] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:34 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:35.024894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:35.025404 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:35.031551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.032102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.032536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.033250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.033694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.034111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.059448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:49:35.111096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:35.119999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5cf808bd-72bf-486c-a6e4-d748687d06c5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.172612 Oct 19 13:49:35.120562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1396/2865] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:34 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:49:35.141228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-de5c9231-2255-4a0d-a8ee-4b9f312ffe14 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 204 len: 0 microversion: 2.1 time: 0.119901 Oct 19 13:49:35.141870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1470/2866] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:49:35 2022] DELETE /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:49:35.150491 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:35.151091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:35.157122 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.157591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.158011 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.158676 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.159111 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.159515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.177940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fb78bd-9228-4d86-bd9c-a35cccc53e81", "name": "network-vif-plugged", "status": "completed", "tag": "0db9f681-a433-4fca-acbf-bb14406e6a8b"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:35.187343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:35.187811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:35.188232 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:35.199551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] Creating event network-vif-plugged:0db9f681-a433-4fca-acbf-bb14406e6a8b for instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 on hv-cinder-maste Oct 19 13:49:35.204662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-c2e5455d-fba9-480e-aed3-ad0067a5baea req-28e52b8c-0490-4c17-8f1e-e1d22ebce02e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 Oct 19 13:49:35.205325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1471/2867] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:49:35.214405 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:35.290642 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:35.301052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fb5815a3-08d0-4fa8-9a90-049cf7798c96 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1469 microversion: 2.1 time: 0.154350 Oct 19 13:49:35.301805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1397/2868] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:35 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:36.144308 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:36.144928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:36.151765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.152245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.152671 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.153387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.153833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.154247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.285690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:36.293806 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7d48ed8c-14bf-454a-8953-9e956279f048 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.154337 Oct 19 13:49:36.294397 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1472/2869] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:36 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:36.324949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:36.325557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:36.327421 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=12 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:36.333782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.334267 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.334702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.335390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:36.335830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:36.336240 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:36.515830 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:36.523815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8dd1992-5d42-4175-a83d-a38b3179f8b1 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1469 microversion: 2.1 time: 0.202971 Oct 19 13:49:36.524395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1398/2870] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:36 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:37.067045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2098f5b5-8b1e-4190-9000-5c0af3c96126", "name": "network-vif-deleted", "tag": "c8ed56ef-2e64-4e50-9fbb-12acc992af85"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:37.077398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.077884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.078335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.090944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] Creating event network-vif-deleted:c8ed56ef-2e64-4e50-9fbb-12acc992af85 for instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 on hv-cinder-maste Oct 19 13:49:37.096393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-3365491c-3c9b-407f-9146-b238b1017ffd req-ffeb2936-1a81-4b7b-9854-40675e957fe5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Oct 19 13:49:37.101081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1473/2871] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:49:37.318248 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:37.318860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:37.325256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.325868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.326132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.326835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.327271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.327685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.465203 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:37.476495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cee9d4be-204d-4643-a8d1-896a85fcdfc5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1264 microversion: 2.1 time: 0.162155 Oct 19 13:49:37.477102 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1399/2872] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:37 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:37.557035 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:37.557736 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:37.564146 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.564636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.565110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.565801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.566261 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.566759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.601294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:37.601769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:37.602203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:37.602656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lazy-loading 'fault' on Instance uuid 2098f5b5-8b1e-4190-9000-5c0af3c96126 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:49:37.648525 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ae8e5e13c642fbb9b009cfd52854a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d5b512604844cb828b3d0d93319c1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:37.656430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d222b96c-9c27-4eca-ad76-f4b6c5d242d5 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 200 len: 1304 microversion: 2.1 time: 0.104322 Oct 19 13:49:37.657021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1474/2873] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:37 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:38.498967 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:38.499579 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:38.506692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.507175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.507604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.508295 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.508741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.509189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.641526 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:38.649751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b5f5f3bc-3506-4667-9fa3-e33848e01e14 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1451 microversion: 2.1 time: 0.154644 Oct 19 13:49:38.650321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1400/2874] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:38 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:38.674260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:38.674814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:38.679505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:49:38.680155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] [instance: 2098f5b5-8b1e-4190-9000-5c0af3c96126] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:49:38.681875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.682389 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.682794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.683508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.683953 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.684366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.686278 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.686749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.687170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.687841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:38.688276 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:38.688682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:38.689713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:49:38.703166 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] HTTP exception thrown: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Request method failure captured: Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 HTTP/1.1 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUABj1zVDy0R4gwzhb9kXqIhtyYSEkX77PtcO9cYhrBDB7TDvO2DhyjpEgUweQmI7IliOAh4M11q-Ux6GA343wL5f4RNfs5U2t-ZQdryx2xsI7nBu_Z78CWpi0c936whWPwAyo2hr-SNZjTY0ePVpxM1D1ik-eIRbDkx6IFVCHzBWmh4 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 18d5b512604844cb828b3d0d93319c1c Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-VolumesNegativeTest-468312795 Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:49:38.705060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_18d5b512604844cb828b3d0d93319c1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/18d5b512604844cb828b3d0d93319c1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/18d5b512604844cb828b3d0d93319c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/18d5b512604844cb828b3d0d93319c1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-VolumesNegativeTest-468312795 Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 18d5b512604844cb828b3d0d93319c1c Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-VolumesNegativeTest-468312795 Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-VolumesNegativeTest-468312795-project Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 38ae8e5e13c642fbb9b009cfd52854a9 Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-VolumesNegativeTest-468312795-project Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. Oct 19 13:49:38.706689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '2098f5b5-8b1e-4190-9000-5c0af3c96126'} Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:49:38.707739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. Oct 19 13:49:38.709250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:49:38.710741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] Returning 404 to user: Instance 2098f5b5-8b1e-4190-9000-5c0af3c96126 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:49:38.710741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d6d99002-e6ff-454e-94bf-942c46def924 tempest-VolumesNegativeTest-468312795 tempest-VolumesNegativeTest-468312795-project] 10.222.0.17 "GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126" status: 404 len: 111 microversion: 2.1 time: 0.031088 Oct 19 13:49:38.710741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1401/2875] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:38 2022] GET /compute/v2.1/servers/2098f5b5-8b1e-4190-9000-5c0af3c96126 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:49:38.822458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:49:38.830453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-69319772-15b0-4c83-a1f2-c4eba3080972 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1451 microversion: 2.1 time: 0.161682 Oct 19 13:49:38.830961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1475/2876] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:49:38 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:49:40.867250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fb78bd-9228-4d86-bd9c-a35cccc53e81", "tag": "0db9f681-a433-4fca-acbf-bb14406e6a8b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:49:40.877685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:49:40.878080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:49:40.878544 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:49:40.890232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] Creating event network-changed:0db9f681-a433-4fca-acbf-bb14406e6a8b for instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 on hv-cinder-maste Oct 19 13:49:40.895616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-4ad0ce91-ba3c-4a20-a31b-0db7e0befa78 req-a7c01d14-2b2e-43d0-9d38-677d3d2fbba8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032019 Oct 19 13:49:40.896835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1402/2877] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:35.401145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:35.401892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:35.405838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:35.406499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=4 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:35.407988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 13:51:35.408105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:51:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 (ip 10.222.0.17) !!! Oct 19 13:51:35.416713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:35.417244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:35.417688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:35.418381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:35.418838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:35.419260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:35.449356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:51:35.532899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-60e14811-40b3-477c-b405-d1c6bb2e8f32 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 204 len: 0 microversion: 2.1 time: 0.137911 Oct 19 13:51:35.533968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1476/2878] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:51:35 2022] DELETE /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:51:35.541092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:35.541893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=88 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:35.543839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 13:51:35.543935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:51:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 (ip 10.222.0.17) !!! Oct 19 13:51:35.551214 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:35.551948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:35.564373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:35.564890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:35.565316 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:35.566002 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:35.566446 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:35.566864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:35.832381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:35.845282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-85e4722b-5e90-4bbb-a89f-515aea0b3070 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1575 microversion: 2.1 time: 0.306348 Oct 19 13:51:35.846135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1403/2879] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:35 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1575 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:36.876897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:36.877588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:36.884492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:36.884997 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:36.885430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:36.886140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:36.886586 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:36.887002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:37.032550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:37.040800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e8793697-db66-4056-ac70-4ead3629af6b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1575 microversion: 2.1 time: 0.169590 Oct 19 13:51:37.041413 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1477/2880] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:36 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:37.894733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fb78bd-9228-4d86-bd9c-a35cccc53e81", "name": "network-vif-deleted", "tag": "0db9f681-a433-4fca-acbf-bb14406e6a8b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:37.905444 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:37.906331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:37.906744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:37.931297 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] Creating event network-vif-deleted:0db9f681-a433-4fca-acbf-bb14406e6a8b for instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 on hv-cinder-maste Oct 19 13:51:37.936181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-0253a842-3c09-47ac-adb7-e6e26cd0d5c3 req-1f74b073-b2a8-4bcb-a5b5-f5bebd8acb45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045705 Oct 19 13:51:37.937178 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1404/2881] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:38.064881 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:38.066614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:38.073884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:38.074457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:38.074971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:38.075758 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:38.076392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:38.077155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:38.160659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:38.172912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bea16194-5989-4028-bf84-72ad7b6c460c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 200 len: 1224 microversion: 2.1 time: 0.112452 Oct 19 13:51:38.182976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1478/2882] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:38 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:39.207015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:39.208169 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:39.218485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:39.218929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:39.219367 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:39.220049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:39.220494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:39.220900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:39.234810 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] HTTP exception thrown: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Request method failure captured: Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 HTTP/1.1 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUABEqg9jJiufzNmaC8R2C4TPNcktkyTKqm4k6b7YR38qxg7mb_9becresQq_WBifEqM1nO_meD1FTYHnR2gNoOv0OOYg6bY6Mr7uLEqfPas-CbXea2F14pKMW-IaYKoeiDNJc1r6csSti1YGdHdhfuPow5tO73cYWS4t30BzUO5PKT4 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:51:39.236450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3a0f0cc24374aeebc0b023e4a79a5de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ad89cdd33ea645d8948465fe0c88a695 Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:51:39.237736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '62fb78bd-9228-4d86-bd9c-a35cccc53e81'} Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:51:39.238471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:51:39.239761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:51:39.240856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Returning 404 to user: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:51:39.240856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-61650f55-1fba-4f40-b2bc-624d4f29960b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 404 len: 111 microversion: 2.1 time: 0.039036 Oct 19 13:51:39.240856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1405/2883] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:39 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:51:39.349347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-834785877", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694965556", "security_groups": [{"name": "tempest-secgroup-smoke-880256063"}], "block_device_mapping_v2": [{"uuid": "f544bfff-0ada-4748-8206-8e0e368e6b73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa3e645-46a5-47f6-8f05-46de41db5195"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:39.464755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] validate_networks() for [('3aa3e645-46a5-47f6-8f05-46de41db5195', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:51:39.903514 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:51:39.903942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:51:39.904412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:51:39.904826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:51:39.905541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:51:39.915110 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:39.915593 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:39.916027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:39.916751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:39.917241 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:39.917665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:39.935042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:51:39.939214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for user ad89cdd33ea645d8948465fe0c88a695 and project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:51:40.001511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:51:40.004800 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f544bfff-0ada-4748-8206-8e0e368e6b73',volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:51:40.145256 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fe416d6d-bb72-4cc9-9e0d-8a4c08e6ca2a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800139 Oct 19 13:51:40.145916 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1479/2884] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:51:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:51:40.157471 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-ea39cd23-c641-43da-80c7-e17ec78207b1 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:40.157985 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-ea39cd23-c641-43da-80c7-e17ec78207b1 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:40.214562 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-ea39cd23-c641-43da-80c7-e17ec78207b1 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:40.221921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-ea39cd23-c641-43da-80c7-e17ec78207b1 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1093 microversion: 2.1 time: 0.068611 Oct 19 13:51:40.222850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1406/2885] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:40 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:41.244076 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:41.244768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:41.251922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:41.252537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:41.253103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:41.253905 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:41.254462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:41.255012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:41.329503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:41.339070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3fdabc30-fdd3-4d84-bbfb-cdbac2c30d38 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1209 microversion: 2.1 time: 0.098929 Oct 19 13:51:41.339633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1480/2886] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:41 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:42.363049 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:42.363666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:42.371279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:42.371770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:42.372588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:42.373377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:42.373939 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:42.374451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:42.579799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:42.587914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57a30870-7d6d-4402-9f1e-cae29a9a3c03 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.228868 Oct 19 13:51:42.588470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1407/2887] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:42 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:42.629360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f087e4e-f0e4-4884-ae7b-78ca70b8b435", "tag": "d67a113c-935b-4a84-b9ad-152551d32c1b"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:42.639756 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:42.640234 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:42.640669 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:42.660791 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] Creating event network-changed:d67a113c-935b-4a84-b9ad-152551d32c1b for instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 on hv-cinder-maste Oct 19 13:51:42.668979 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-a5d26fb6-fc76-4c8a-b9d1-77abdd209055 req-29293103-55c7-4048-affe-1fb1606e0a4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042937 Oct 19 13:51:42.670029 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1481/2888] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:43.612457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:43.613050 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:43.620635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:43.621147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:43.621578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:43.622271 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:43.622716 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:43.623135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:44.068521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:44.079565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f0323f21-0acc-4784-9f26-04585e182f43 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.471849 Oct 19 13:51:44.080135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1408/2889] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:43 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:45.108719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:45.110344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:45.120848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:45.121696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:45.122430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:45.123551 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:45.124521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:45.124996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:45.272167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:45.282706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4593a011-ae5f-49ff-a3a0-5427db4471f7 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.181724 Oct 19 13:51:45.283270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1482/2890] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:45 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:46.307551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:46.308092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:46.316419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:46.316419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:46.316758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:46.317862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:46.318470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:46.319065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:46.462115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:46.470032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57dc1f73-68a3-46c0-9de6-395c58895aa6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.168428 Oct 19 13:51:46.470596 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1409/2891] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:46 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:47.503434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:47.504107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:47.510961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:47.511583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:47.511928 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:47.512654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:47.513174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:47.513623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:47.654977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:47.663262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f5445f99-373b-4d75-b11e-6d0d574be131 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.164188 Oct 19 13:51:47.663801 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1483/2892] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:47 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:48.690336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:48.691385 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:48.702534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:48.703100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:48.703529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:48.704223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:48.704665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:48.705113 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:48.842572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:48.851206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-50759056-5894-44f5-a074-3c21a827523c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.167438 Oct 19 13:51:48.851773 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1410/2893] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:48 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:49.886468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:49.887608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:49.895583 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:49.896068 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:49.896496 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:49.897209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:49.897657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:49.898077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:49.927357 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:49.946666 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:50.027531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:50.035446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-486650bd-5a66-449e-b0ae-0027a286fcbf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.155704 Oct 19 13:51:50.035996 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1484/2894] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:49 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:51.063018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:51.063622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:51.066306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:51:51.072389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:51.072914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:51.073403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:51.074132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:51.074619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:51.075075 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:51.219874 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:51.228557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-144bf83c-48bb-42c1-8e0a-d830f667246b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.172149 Oct 19 13:51:51.229143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1411/2895] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:51 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:52.252980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:52.253720 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:52.262378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.262972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.263508 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:52.264358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:52.264912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:52.265471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:52.407437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:52.415808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c4a7a7e8-5ee2-4f90-b4d1-09f5d8467a31 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.167852 Oct 19 13:51:52.416565 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1485/2896] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:52 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:53.387294 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f087e4e-f0e4-4884-ae7b-78ca70b8b435", "name": "network-vif-plugged", "status": "completed", "tag": "d67a113c-935b-4a84-b9ad-152551d32c1b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:53.397894 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:53.398396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:53.398813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:53.410769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] Creating event network-vif-plugged:d67a113c-935b-4a84-b9ad-152551d32c1b for instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 on hv-cinder-maste Oct 19 13:51:53.416955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-1367f3eb-a091-44d5-807e-9ad3626f8052 req-f8e98a5b-c381-495f-b5ac-b251ebd020ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Oct 19 13:51:53.417654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1412/2897] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:51:53.438909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:53.439509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:53.446765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:53.447457 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:53.448064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:53.448946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:53.449888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:53.450252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:53.598889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:53.606849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e460dfbf-5eee-41b5-9e6a-a01cd4c89292 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1264 microversion: 2.1 time: 0.172090 Oct 19 13:51:53.607429 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1486/2898] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:53 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:54.630164 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:54.630853 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:54.637160 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:54.637629 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:54.638052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:54.638732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:54.639170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:54.639575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:54.773029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:54.780899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bc7dc77d-f910-465e-853e-480bfa5805df tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1451 microversion: 2.1 time: 0.155398 Oct 19 13:51:54.781584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1413/2899] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:54 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:54.814089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:51:54.814707 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:51:54.821470 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:54.821888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:54.822359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:54.823045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:54.823495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:54.823915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:54.967405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:51:54.975922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-039ae331-e064-413a-a9d4-9f52a71ee37b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1451 microversion: 2.1 time: 0.167540 Oct 19 13:51:54.976486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1487/2900] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:51:54 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:51:56.634559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f087e4e-f0e4-4884-ae7b-78ca70b8b435", "tag": "d67a113c-935b-4a84-b9ad-152551d32c1b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:51:56.645414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:51:56.646251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:51:56.646506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:51:56.659091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] Creating event network-changed:d67a113c-935b-4a84-b9ad-152551d32c1b for instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 on hv-cinder-maste Oct 19 13:51:56.664808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-bfd87193-40a0-4311-9f0a-dd505278b103 req-adc1d6d0-7785-4e13-b110-3d835361233c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Oct 19 13:51:56.665515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1414/2901] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:20.048586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=26 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:20.049484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=50 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:20.051201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:20.051732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:20.053808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:20.054415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:20.054522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:20.055111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:20.061627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.061780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.062108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.062208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.062542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.062641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.063233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.063324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.063680 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.063769 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.064114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.064247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.078524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] HTTP exception thrown: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Request method failure captured: Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: DELETE /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b HTTP/1.1 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_gzO5MD7vOdQBW2spKKLnta8r4RLviGDeJgaE_gWoklIRtDgQbxnMAmvcY_ulW2FZC29cWoczq6VjpCAUBj-WFVKD8lb_srb6JB8Wm5w8sbCGoXSfRGHQo2_whpgejYyoBQBhU4eu_5MgiXOZAvfwhr1zQBFIZhw8MGc8irvenWGsA Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:52:20.080277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a5888bfc20042a791f6798975b860fd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 7e6d95493f8e4b58a9a212999916e6b1 Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.081931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '320026c6-9bba-465d-9022-c32b670f3a9b'} Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:20.082612 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.083633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.084610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] HTTP exception thrown: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.084690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Returning 404 to user: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:20.084690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62e5c8e7-93d4-406a-bd4d-825090809c0e tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 404 len: 111 microversion: 2.20 time: 0.034768 Oct 19 13:52:20.084690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1415/2902] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Oct 19 13:52:20 2022] DELETE /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Request method failure captured: Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a HTTP/1.1 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_iNhFx5h8z5sLVX25j5wWT-zJbqYslNjTl6886nMj6MxFsrnLUxYy29awTE39dGFBeDMX9SvpupEk6Md6-MLxfo3nXIkqxn8UsZ-Cn8uNM2w4BhDXLbi7ZFTmif0eHcObvPh_w7nS6-eL-RaVkV3_SpmVokWfFKCVO5hTWIi9kMoQo Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:52:20.085070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1e961b210664d81ab76acffd94b70d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: ab18c81a3b6a4db98b3007c620950aef Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.086646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '0101bf0a-6484-4009-a3af-b1fe8359e58a'} Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:20.087595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.089103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.090559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Returning 404 to user: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:20.090559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-32acfd7f-916f-4d62-9ca8-a2e6af4ee0b2 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 404 len: 111 microversion: 2.1 time: 0.037386 Oct 19 13:52:20.090559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1488/2903] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:52:20 2022] DELETE /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:52:20.090777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:20.090862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 320026c6-9bba-465d-9022-c32b670f3a9b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:20.093031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:20.093623 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] [instance: 0101bf0a-6484-4009-a3af-b1fe8359e58a] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:20.097052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.097518 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.097935 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.098604 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.099042 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.099447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.099902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.100379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.100808 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.101526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:20.101972 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:20.102519 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:20.113426 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] HTTP exception thrown: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Request method failure captured: Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b HTTP/1.1 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_gzO5MD7vOdQBW2spKKLnta8r4RLviGDeJgaE_gWoklIRtDgQbxnMAmvcY_ulW2FZC29cWoczq6VjpCAUBj-WFVKD8lb_srb6JB8Wm5w8sbCGoXSfRGHQo2_whpgejYyoBQBhU4eu_5MgiXOZAvfwhr1zQBFIZhw8MGc8irvenWGsA Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:52:20.114982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a5888bfc20042a791f6798975b860fd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 7e6d95493f8e4b58a9a212999916e6b1 Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.116369 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '320026c6-9bba-465d-9022-c32b670f3a9b'} Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:20.117148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. Oct 19 13:52:20.118485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.119404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Returning 404 to user: Instance 320026c6-9bba-465d-9022-c32b670f3a9b could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:20.119404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c81ed69b-e196-4460-be41-2d7d6bcf48a6 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b" status: 404 len: 111 microversion: 2.20 time: 0.029808 Oct 19 13:52:20.119533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] HTTP exception thrown: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.120131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1416/2904] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:52:20 2022] GET /compute/v2.1/servers/320026c6-9bba-465d-9022-c32b670f3a9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Request method failure captured: Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a HTTP/1.1 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_iNhFx5h8z5sLVX25j5wWT-zJbqYslNjTl6886nMj6MxFsrnLUxYy29awTE39dGFBeDMX9SvpupEk6Md6-MLxfo3nXIkqxn8UsZ-Cn8uNM2w4BhDXLbi7ZFTmif0eHcObvPh_w7nS6-eL-RaVkV3_SpmVokWfFKCVO5hTWIi9kMoQo Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:52:20.120275 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1e961b210664d81ab76acffd94b70d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1e961b210664d81ab76acffd94b70d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: f1e961b210664d81ab76acffd94b70d7 Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeTestJSON-694535039 Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: ab18c81a3b6a4db98b3007c620950aef Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeTestJSON-694535039-project Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.122021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '0101bf0a-6484-4009-a3af-b1fe8359e58a'} Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:52:20.122714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. Oct 19 13:52:20.123768 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:52:20.124910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] Returning 404 to user: Instance 0101bf0a-6484-4009-a3af-b1fe8359e58a could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:52:20.124910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-02b827c8-790b-4e09-a944-826553636617 tempest-AttachVolumeTestJSON-694535039 tempest-AttachVolumeTestJSON-694535039-project] 10.222.0.17 "GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a" status: 404 len: 111 microversion: 2.1 time: 0.032557 Oct 19 13:52:20.124910 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1489/2905] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:20 2022] GET /compute/v2.1/servers/0101bf0a-6484-4009-a3af-b1fe8359e58a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 13:52:28.794309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fa39ea66-2879-47ab-b512-cdd832a8a104 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: .version_select at 0x7ff4fc98db80>, body: {"keypair": {"name": "tempest-keypair-228908587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJWMvWfXX+PALe8n91rOdPZsrKiSQiZGIcsBHsLI9FW0tcFIujYm4auqmzLxP9ITsUFCN/xhNFhlclOXm1Ps7TlE5IpvXH/rhNVp0B/3yGnKiRVLkIcvrLN6D6rRuAQLw=="}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:28.810957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-fa39ea66-2879-47ab-b512-cdd832a8a104 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:52:28.815325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-fa39ea66-2879-47ab-b512-cdd832a8a104 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:52:28.845401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fa39ea66-2879-47ab-b512-cdd832a8a104 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176279 Oct 19 13:52:28.846017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1417/2906] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:30.123363 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126510472", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60d117b1-c052-4c81-a285-bf6c947d79c2"}], "security_groups": [{"name": "tempest-securitygroup--6364063"}], "key_name": "tempest-keypair-228908587", "user_data": "}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:30.132321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=4 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:30.132988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=4 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:30.235557 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] validate_networks() for [('60d117b1-c052-4c81-a285-bf6c947d79c2', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:52:30.617451 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:52:30.618040 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:52:30.618544 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:52:30.618952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:52:30.619361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:52:30.628719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:30.629299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:30.629731 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:30.630447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:30.630895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:30.631431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:30.648210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:52:30.652378 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:52:30.663788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:52:30.666303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:52:30.714504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ecc3c3ce-5f91-49b4-9bd1-d3ddb2cbd4a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.595297 Oct 19 13:52:30.715455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1490/2907] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:52:30 2022] POST /compute/v2.1/servers => generated 399 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:52:30.724428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=4 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:30.729723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e054e2ca-f302-43f4-ba0b-9900c9cf7399 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:30.730677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e054e2ca-f302-43f4-ba0b-9900c9cf7399 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:30.788041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-e054e2ca-f302-43f4-ba0b-9900c9cf7399 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:30.796557 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e054e2ca-f302-43f4-ba0b-9900c9cf7399 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1241 microversion: 2.1 time: 0.073219 Oct 19 13:52:30.797175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1418/2908] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:30 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:31.819550 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6712d4f8-b5e6-41e4-bfe3-f2fc1dc1b0d2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:31.820784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6712d4f8-b5e6-41e4-bfe3-f2fc1dc1b0d2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:31.885500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6712d4f8-b5e6-41e4-bfe3-f2fc1dc1b0d2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:31.893717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6712d4f8-b5e6-41e4-bfe3-f2fc1dc1b0d2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1241 microversion: 2.1 time: 0.078228 Oct 19 13:52:31.894541 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1491/2909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:31 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:52:32.917118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-23024076-9bf8-4340-800c-0240872b8872 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:32.917790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-23024076-9bf8-4340-800c-0240872b8872 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:32.973325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-23024076-9bf8-4340-800c-0240872b8872 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:32.981979 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-23024076-9bf8-4340-800c-0240872b8872 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1241 microversion: 2.1 time: 0.068860 Oct 19 13:52:32.982569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1419/2910] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:32 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:34.008678 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ebb51e81-9bf4-4d1a-892b-d762b6a3ee50 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:34.009734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ebb51e81-9bf4-4d1a-892b-d762b6a3ee50 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:34.076719 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ebb51e81-9bf4-4d1a-892b-d762b6a3ee50 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:34.083721 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ebb51e81-9bf4-4d1a-892b-d762b6a3ee50 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1241 microversion: 2.1 time: 0.081859 Oct 19 13:52:34.084588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1492/2911] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:34 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:35.108911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:35.109588 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:35.116931 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:35.117480 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:35.117832 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:35.118517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:35.118962 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:35.119561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:35.181505 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:35.189839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-79865d5e-1661-424d-a3b2-ca6bbbb68b85 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1245 microversion: 2.1 time: 0.085051 Oct 19 13:52:35.190400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1420/2912] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:35 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:36.211489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:36.212098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:36.219963 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:36.220571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:36.221447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:36.222197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:36.222751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:36.223240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:36.283837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:36.292265 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-36805a3f-28e6-4357-b941-261eb843e51f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1299 microversion: 2.1 time: 0.084526 Oct 19 13:52:36.292840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1493/2913] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:36 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:37.320524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:37.321129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:37.327598 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.328300 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.328644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.329528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.329978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.330434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.351817 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f85d415-a454-4bd8-8230-f10c25bd5a40", "tag": "ac9a4fdc-5e9a-47b3-9a01-39153c373980"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:37.378454 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:37.379677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:37.380190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:37.392099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] Creating event network-changed:ac9a4fdc-5e9a-47b3-9a01-39153c373980 for instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 on hv-cinder-maste Oct 19 13:52:37.397409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-6948d459-d9eb-4768-8e56-630c5d1d86c0 req-3144e650-dada-4038-b933-35538bd40d96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049699 Oct 19 13:52:37.398201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1494/2914] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:37.581948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:37.590782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35c14043-91f0-451c-81c2-24a6c30cc065 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.275048 Oct 19 13:52:37.591365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1421/2915] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:37 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:38.614155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:38.614850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:38.621746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:38.622220 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:38.622651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:38.623331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:38.623772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:38.624153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:38.762964 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:38.771664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9a64bec5-6697-48fe-8058-57052949f521 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.161701 Oct 19 13:52:38.772251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1495/2916] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:38 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:39.799462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:39.800506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:39.810377 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:39.810859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:39.811290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:39.811978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:39.812485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:39.812919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:39.956167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:39.966692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7b068e0a-c551-42fd-aba5-a8b657eae46b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.173784 Oct 19 13:52:39.967251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1422/2917] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:39 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:40.991978 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:40.992906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:40.995884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:41.002789 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:41.003318 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:41.003856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:41.004702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:41.005296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:41.005822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:41.143134 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:41.150899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4fe1653b-51e8-4df2-9a38-524267cee9a7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.163776 Oct 19 13:52:41.151471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1496/2918] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:40 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:42.178082 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:42.178923 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:42.187415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:42.187890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:42.188314 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:42.189033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:42.189475 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:42.189888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:42.334829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:42.344344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6c953285-ebd9-40d8-8826-8584b1a7bdd3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.173158 Oct 19 13:52:42.344900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1423/2919] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:42 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:43.367640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:43.368247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:43.375252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:43.375840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:43.376281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:43.377002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:43.377450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:43.377865 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:43.511582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:43.519474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d6dba0cb-07bd-4560-b6f6-c1021d1d817d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.155758 Oct 19 13:52:43.520107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1497/2920] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:43 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:43.584117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f85d415-a454-4bd8-8230-f10c25bd5a40", "name": "network-vif-plugged", "status": "completed", "tag": "ac9a4fdc-5e9a-47b3-9a01-39153c373980"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:43.590618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=8 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:43.598934 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:43.599344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:43.599755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:43.611356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] Creating event network-vif-plugged:ac9a4fdc-5e9a-47b3-9a01-39153c373980 for instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 on hv-cinder-maste Oct 19 13:52:43.617158 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-7fe21dea-6ec3-49e7-a4db-0feb29886976 req-12032d85-79d0-4e12-a403-100d81d5b1a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Oct 19 13:52:43.618401 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1424/2921] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:44.546471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:44.547458 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:44.550582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=10 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:52:44.559672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:44.560154 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:44.560600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:44.561314 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:44.561766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:44.562189 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:44.704074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:44.711958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-13da5495-1d83-42d5-9a4e-45a510a36380 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1364 microversion: 2.1 time: 0.172188 Oct 19 13:52:44.712523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1498/2922] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:44 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:45.737334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:45.738027 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:45.745080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.745582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.746185 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:45.747010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.747454 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.747865 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:45.882948 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:52:45.894582 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-025b4ca0-754a-44a2-a06b-c6615cd2253a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1555 microversion: 2.1 time: 0.162057 Oct 19 13:52:45.895312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1425/2923] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:52:45 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:52:45.917028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:52:45.917528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:52:45.924434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.925136 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.925600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:45.926287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:45.926735 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:45.927151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:46.005517 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3abe614e-6252-48d5-9a4a-a06b77768540 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091960 Oct 19 13:52:46.006254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1499/2924] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:52:45 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:52:47.217416 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f85d415-a454-4bd8-8230-f10c25bd5a40", "tag": "ac9a4fdc-5e9a-47b3-9a01-39153c373980"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:52:47.227693 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:52:47.228192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:52:47.228638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:52:47.240085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] Creating event network-changed:ac9a4fdc-5e9a-47b3-9a01-39153c373980 for instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 on hv-cinder-maste Oct 19 13:52:47.245525 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-8850fc80-281d-49a8-8006-7a173abab8bb req-af7b0c0f-c655-4794-bf9b-91500b59d07c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031822 Oct 19 13:52:47.246260 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1426/2925] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:23.392970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:23.393730 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=38 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:23.398168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:23.398672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:23.406077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:23.406556 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:23.406984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:23.407664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:23.408104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:23.408516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:23.433545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-acff62ab-bf23-4e93-a927-2cbee41883aa tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/ips" status: 200 len: 151 microversion: 2.1 time: 0.042066 Oct 19 13:53:23.434104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1500/2926] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:53:23 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:24.811373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:24.812132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=34 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:24.813067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:53:24.813204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments (ip 10.222.0.17) !!! Oct 19 13:53:24.818322 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:24.820734 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:24.830201 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:24.830657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:24.831084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:24.831760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:24.832199 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:24.832611 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:25.095733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-0b7e5445-3b3f-429d-bc79-e8e2d88e7d0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285496 Oct 19 13:53:25.096410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1427/2927] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:53:24 2022] POST /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:31.957112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1278534572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694965556", "security_groups": [{"name": "tempest-secgroup-smoke-880256063"}], "block_device_mapping_v2": [{"uuid": "5ae8b28e-43c9-4465-8937-df38bd19a40f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3aa3e645-46a5-47f6-8f05-46de41db5195"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:32.084361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] validate_networks() for [('3aa3e645-46a5-47f6-8f05-46de41db5195', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:53:32.461523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:53:32.461944 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:53:32.462405 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:53:32.462845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:53:32.463254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:53:32.472688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:32.473196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:32.473630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:32.474353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:32.474807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:32.475226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:32.491682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:53:32.495535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Getting quotas for user ad89cdd33ea645d8948465fe0c88a695 and project c3a0f0cc24374aeebc0b023e4a79a5de. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:53:32.559637 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:53:32.561790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ae8b28e-43c9-4465-8937-df38bd19a40f',volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:53:32.709296 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-25f460ab-4479-4ae2-bc4e-2fea7bc3e76a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756239 Oct 19 13:53:32.709918 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1501/2928] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:53:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:53:32.722930 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0727851-a513-4f85-aa80-b3d541f20b8e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:32.723621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b0727851-a513-4f85-aa80-b3d541f20b8e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:32.781636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b0727851-a513-4f85-aa80-b3d541f20b8e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:32.789086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b0727851-a513-4f85-aa80-b3d541f20b8e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1094 microversion: 2.1 time: 0.071466 Oct 19 13:53:32.789654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1428/2929] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:32 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:33.813297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:33.814290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:33.820988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:33.821469 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:33.821898 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:33.822617 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:33.823060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:33.823473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:33.889505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:33.897962 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-90b827fd-d980-4e48-be8f-31cd0741013e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1192 microversion: 2.1 time: 0.089875 Oct 19 13:53:33.898528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1502/2930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:33 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:34.831234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e393dc8d-deff-435d-bdc6-5b02438829b3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: .version_select at 0x7ff4fca37ee0>, body: {"keypair": {"name": "tempest-keypair-1797672646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCoIg78qqmOXKHw//aS/TeV9yTgayjX2LLq67Dl559lQ1GGinfd3wwKBt4x2V9MZX4eh0LSLIPMhMdeimu/syeBFTh6DUD7DiwNzGXjElrS0vEZ6Jh7gOXoVkCw7TUELQ=="}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:34.850309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-e393dc8d-deff-435d-bdc6-5b02438829b3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:53:34.855842 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-e393dc8d-deff-435d-bdc6-5b02438829b3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:53:34.882632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e393dc8d-deff-435d-bdc6-5b02438829b3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055449 Oct 19 13:53:34.883233 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1429/2931] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:53:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:34.921288 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:34.921956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:34.929502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:34.930393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:34.930988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:34.931837 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:34.932589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:34.933462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:35.227231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:35.236233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eb152ff0-218c-48e2-8394-1eff422c84f5 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1277 microversion: 2.1 time: 0.318644 Oct 19 13:53:35.237009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1503/2932] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:34 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:36.260055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:36.260634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:36.262758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:36.269638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:36.270148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:36.270577 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:36.271251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:36.271698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:36.272103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:36.553157 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0ee62-0b59-497a-9146-0bb0aa1d904d", "tag": "b8e230d6-2a88-4008-8bd3-aaa15c7d8228"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:36.563848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:36.564403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:36.564894 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:36.571665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:36.580378 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-fdef4080-692f-4c93-af17-1061e6597f4c tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.324230 Oct 19 13:53:36.581045 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1430/2933] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:36 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:36.582141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] Creating event network-changed:b8e230d6-2a88-4008-8bd3-aaa15c7d8228 for instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d on hv-cinder-maste Oct 19 13:53:36.596252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-a8bc1c0c-f701-47f0-a7a0-2344dbc12e96 req-f2b954d7-5a05-4eb0-845b-0fa32896c9ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046422 Oct 19 13:53:36.597455 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1504/2934] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:53:37.108139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-647782400", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60d117b1-c052-4c81-a285-bf6c947d79c2"}], "security_groups": [{"name": "tempest-securitygroup--1618697393"}], "key_name": "tempest-keypair-1797672646", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:37.212827 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] validate_networks() for [('60d117b1-c052-4c81-a285-bf6c947d79c2', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:53:37.605650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:37.606492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:37.614005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:37.614502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:37.614940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:37.615643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:37.616123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:37.616553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:37.752235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:37.760520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-059b41e6-5639-4aa3-9e0b-667578f2988d tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.159043 Oct 19 13:53:37.761172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1505/2935] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:37 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:37.825349 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:53:37.825835 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:53:37.826208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:53:37.826615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:53:37.827000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:53:37.835973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:37.836443 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:37.836888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:37.837610 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:37.838048 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:37.838458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:37.855517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:53:37.859679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:53:37.871760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:53:37.874172 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:53:37.931345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2667d99a-9333-43ea-86dc-21d07c6d986a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.827448 Oct 19 13:53:37.931990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1431/2936] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:53:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:53:37.943656 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-18fe2d48-ef64-4dda-b43f-e058a0d5e35a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:37.944776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-18fe2d48-ef64-4dda-b43f-e058a0d5e35a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:38.012062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-18fe2d48-ef64-4dda-b43f-e058a0d5e35a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:38.020995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-18fe2d48-ef64-4dda-b43f-e058a0d5e35a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1241 microversion: 2.1 time: 0.081344 Oct 19 13:53:38.021886 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1506/2937] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:37 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:38.787125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:38.787912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:38.795760 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:38.796339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:38.796893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:38.797742 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:38.798285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:38.798762 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:38.940407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:38.948614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b143fe56-2495-4bf3-a4ff-43439b97c883 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.167778 Oct 19 13:53:38.960910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1432/2938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:38 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:39.045552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:39.047062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:39.055788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:39.056277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:39.056872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:39.057591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:39.058079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:39.058504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:39.128237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:39.136603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5ee42065-3814-4c85-a742-961e1853a257 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1311 microversion: 2.1 time: 0.095117 Oct 19 13:53:39.137152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1507/2939] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:39 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:39.972900 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:39.973751 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:39.981374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:39.981965 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:39.982469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:39.983266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:39.983783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:39.984274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:40.162543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:40.163097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:40.174181 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:40.174689 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:40.175119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:40.175823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:40.176266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:40.176767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:40.329936 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:40.341103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d8333a4c-a98f-4194-a144-e4f03008490b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.184222 Oct 19 13:53:40.342479 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1508/2940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:40 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:40.448953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:40.456893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4b26ce09-5912-47bd-8cb5-3aec872fd477 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.488945 Oct 19 13:53:40.457473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1433/2941] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:39 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:40.847572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8", "tag": "109ef672-c183-4183-8d27-ebab1e6fa582"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:40.859750 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:40.860228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:40.871807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:40.883919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] Creating event network-changed:109ef672-c183-4183-8d27-ebab1e6fa582 for instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 on hv-cinder-maste Oct 19 13:53:40.889467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-830c4f39-e16d-4ed2-ac0e-a9d83d2f9e94 req-8e11f445-0177-4e63-98ef-2bbf375f4bcc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045900 Oct 19 13:53:40.890064 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1509/2942] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:41.368920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:41.369803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:41.380384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:41.381103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:41.381715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:41.382678 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:41.383315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:41.383899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:41.481794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:41.482491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:41.489946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:41.490434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:41.490861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:41.491552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:41.491999 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:41.492446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:41.520732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:41.529319 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8583a28d-bfec-4bbe-951a-1d4485608e27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.165835 Oct 19 13:53:41.529890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1434/2943] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:41 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:41.633526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:41.641543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-acbed02a-ae0f-4f22-8584-d72e45435678 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.163911 Oct 19 13:53:41.642077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1510/2944] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:41 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:42.552047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:42.552771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:42.559570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:42.560039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:42.560464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:42.561249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:42.561691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:42.562100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:42.663998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:42.664523 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:42.666577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:42.672445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:42.672951 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:42.673393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:42.674238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:42.674701 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:42.675111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:42.701856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:42.709667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f5be037f-01c1-4363-9ebc-b3692d354760 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.161527 Oct 19 13:53:42.710576 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1435/2945] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:42 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:42.809646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:42.817578 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-21c42e46-b1f1-4873-97bf-851e7520ba63 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.157625 Oct 19 13:53:42.818343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1511/2946] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:42 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:43.736347 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:43.737365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:43.748315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:43.748771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:43.749515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:43.750647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:43.751373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:43.752127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:43.840192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:43.841442 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:43.848266 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:43.848766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:43.849235 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:43.849939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:43.850398 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:43.850822 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:43.888796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:43.899755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1c39ca2f-60cd-40f4-9a27-b0f59e7cbb13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.169780 Oct 19 13:53:43.900517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1436/2947] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:43 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:43.999857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:44.008163 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba639e3b-3c87-454a-b7d1-fde7c830a4ac tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.171850 Oct 19 13:53:44.008743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1512/2948] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:43 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:44.928118 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:44.928771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:44.937065 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:44.937653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:44.938186 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:44.939035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:44.939615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:44.940151 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:45.030887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:45.031495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:45.038521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:45.039093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:45.039562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:45.040239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:45.040675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:45.041133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:45.078308 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:45.086381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a66bb954-acc1-4cf5-8e93-75b268d565f4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.163641 Oct 19 13:53:45.086989 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1437/2949] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:44 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:45.176538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:45.188414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ee265589-5102-4fbe-9fa5-942527176bc6 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.161099 Oct 19 13:53:45.189145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1513/2950] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:45 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:46.037920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8", "name": "network-vif-plugged", "status": "completed", "tag": "109ef672-c183-4183-8d27-ebab1e6fa582"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:46.049802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:46.050363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:46.050929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:46.063154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] Creating event network-vif-plugged:109ef672-c183-4183-8d27-ebab1e6fa582 for instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 on hv-cinder-maste Oct 19 13:53:46.068232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-542995f6-2afb-44aa-b36d-d0382a130464 req-116592e1-3f8c-4f41-9f1f-fa380ad02b96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034225 Oct 19 13:53:46.069384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1438/2951] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:46.109589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:46.110160 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:46.121542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:46.122251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:46.122853 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:46.123558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:46.124008 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:46.124428 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:46.220175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:46.221249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:46.231304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:46.231819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:46.232251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:46.232982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:46.233432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:46.233850 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:46.260780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:46.269253 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5acb4604-de29-4f14-9719-35ac12adf275 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.163509 Oct 19 13:53:46.270141 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1514/2952] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:46 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:46.406387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:46.415009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1b643762-62fd-40ee-973b-097bf776167a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.201688 Oct 19 13:53:46.415467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1439/2953] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:46 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:47.295919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:47.297066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:47.305376 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:47.305869 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:47.306293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:47.306980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:47.307426 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:47.307848 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:47.437905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:47.438477 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:47.443842 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:47.445309 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:47.445787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:47.446208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:47.446885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:47.447324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:47.447732 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:47.452368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8a3f2b34-2fb7-421d-a12d-8786f0a77eca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1367 microversion: 2.1 time: 0.163047 Oct 19 13:53:47.453059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1515/2954] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:47 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:47.598987 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:47.607382 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-87267a77-1c39-40e7-b335-2d982dfce159 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.173356 Oct 19 13:53:47.607940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1440/2955] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:47 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:53:48.085107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0ee62-0b59-497a-9146-0bb0aa1d904d", "name": "network-vif-plugged", "status": "completed", "tag": "b8e230d6-2a88-4008-8bd3-aaa15c7d8228"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:48.089968 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=8 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:48.096540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.097045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.097480 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.114697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] Creating event network-vif-plugged:b8e230d6-2a88-4008-8bd3-aaa15c7d8228 for instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d on hv-cinder-maste Oct 19 13:53:48.119830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-5065b573-91c5-4a3a-a5a3-0ad7c0a3d051 req-adbf5c5f-1e16-4c2c-aa32-ee71fa497a42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039219 Oct 19 13:53:48.120409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1516/2956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:48.479583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:48.480532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:48.483663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:48.484605 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=12 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:53:48.494482 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.495207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.495893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.497014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.497713 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.498350 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.638893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:48.640079 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:48.640970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:48.646864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8dc94e72-5657-4632-960c-efa8ae513c0e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1557 microversion: 2.1 time: 0.174136 Oct 19 13:53:48.647495 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1441/2957] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:48 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:48.648045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.648516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.648988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.649672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.650123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.650543 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.668616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:48.669149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:48.675132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.675617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.676044 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.676995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:48.677534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:48.677953 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:48.755915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5b8cd294-717c-45d0-abd9-f591a83a4a2d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090941 Oct 19 13:53:48.756681 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1442/2958] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:53:48 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:48.787495 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:48.795796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d9247900-de35-4e67-9340-2669e60f093b tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1265 microversion: 2.1 time: 0.160744 Oct 19 13:53:48.796406 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1517/2959] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:48 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:49.708813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8", "tag": "109ef672-c183-4183-8d27-ebab1e6fa582"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:49.718674 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:49.719147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:49.719926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:49.731786 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] Creating event network-changed:109ef672-c183-4183-8d27-ebab1e6fa582 for instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 on hv-cinder-maste Oct 19 13:53:49.737033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-08b3d76d-652b-4c4b-b22e-a603ee4be7c2 req-5831d443-8290-4cb8-a066-38e14d019ed6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Oct 19 13:53:49.737726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1443/2960] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:53:49.818836 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:49.819498 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:49.826491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:49.827013 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:49.827449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:49.828182 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:49.828646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:49.829081 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:49.975798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:49.984153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-02f8ba0d-f115-4d5b-ab4d-baf629ee8663 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1453 microversion: 2.1 time: 0.169291 Oct 19 13:53:49.984970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1518/2961] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:49 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:50.008081 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:53:50.008428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:53:50.014841 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:50.015321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:50.015749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:50.016438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:50.016893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:50.017311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:50.232772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:53:50.241390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6811a95f-5567-4d22-a205-1caccbf8970f tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1453 microversion: 2.1 time: 0.238240 Oct 19 13:53:50.241960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1444/2962] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:53:50 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:53:51.876914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0ee62-0b59-497a-9146-0bb0aa1d904d", "tag": "b8e230d6-2a88-4008-8bd3-aaa15c7d8228"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:53:51.887870 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:53:51.888430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:53:51.888947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:53:51.900297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] Creating event network-changed:b8e230d6-2a88-4008-8bd3-aaa15c7d8228 for instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d on hv-cinder-maste Oct 19 13:53:51.905833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-31149b62-95de-4429-8254-e8a345004f36 req-4b05609f-bff4-4a0a-8b30-a5357a561c95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033396 Oct 19 13:53:51.906697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1519/2963] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:25.680359 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:25.681224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:25.684215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:25.685236 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=76 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:25.694543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.695285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.695955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.697032 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.697711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.698344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.727204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-55651deb-3599-4486-a10e-780041d05224 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/ips" status: 200 len: 149 microversion: 2.1 time: 0.053272 Oct 19 13:54:25.727767 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1445/2964] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:54:25 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:25.743476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:25.747109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:25.750414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:25.751311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=92 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:25.757362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.757849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.758290 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.758983 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.759438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.759864 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.848849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: POST /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/os-volume_attachments HTTP/1.1 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 74 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:54:25.850619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {"volumeAttachment": {"volumeId": "57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b"}} Oct 19 13:54:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'server_id': 'd46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8', 'body': {'volumeAttachment': {'volumeId': '57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b'}}} Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:25.852887 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:25.854324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 400 to user: Invalid volume: volume 57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b is already attached to instances: 3f85d415-a454-4bd8-8230-f10c25bd5a40 {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d11d2387-6833-45b3-a4e8-2b0fce0007a5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115826 Oct 19 13:54:25.855762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1520/2965] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:54:25 2022] POST /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:54:25.861250 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:25.861744 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:25.868231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.868706 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.869165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.869848 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.870290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.870710 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.896036 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:54:25.977243 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-35f0b16a-370f-4338-ba55-3becf153ab48 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 204 len: 0 microversion: 2.1 time: 0.119779 Oct 19 13:54:25.978088 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1446/2966] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:54:25 2022] DELETE /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:54:25.987859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:25.988464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:25.995611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.996089 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.996518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:25.997244 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:25.997693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:25.998113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:26.144173 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:26.152690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bfdf748f-a58d-4f5c-8094-14c1e8641c13 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1681 microversion: 2.1 time: 0.169205 Oct 19 13:54:26.153299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1521/2967] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:25 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:27.180768 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:27.181675 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:27.190296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:27.190891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:27.191430 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:27.192301 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:27.192999 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:27.193519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:27.326153 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:27.334346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2b8ce021-15ce-4515-b08e-9917eeda36a8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1681 microversion: 2.1 time: 0.158906 Oct 19 13:54:27.334941 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1447/2968] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:27 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:28.337373 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8", "name": "network-vif-deleted", "tag": "109ef672-c183-4183-8d27-ebab1e6fa582"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:28.349560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.349560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.349560 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.362057 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:28.363831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:28.370511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] Creating event network-vif-deleted:109ef672-c183-4183-8d27-ebab1e6fa582 for instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 on hv-cinder-maste Oct 19 13:54:28.380195 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-67e6e8a6-8c0f-408f-a41c-b1aa6c902f6f req-ee1bda48-98ff-4dd1-a23e-6c7a0744b8ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122975 Oct 19 13:54:28.382187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1522/2969] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:28.382963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.383466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.383968 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.385408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.389173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.389589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.475184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:28.475749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:28.476372 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:28.476776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.objects.instance [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lazy-loading 'fault' on Instance uuid d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 {{(pid=118982) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:54:28.523258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:28.531783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2bd6b8b1-aa9a-4e94-9d48-05f7c298179d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 200 len: 1331 microversion: 2.1 time: 0.178032 Oct 19 13:54:28.532355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1448/2970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:28 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:29.561476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:29.562780 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:29.569717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:29.570205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:29.570642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:29.571332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:29.571781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:29.572229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:29.588093 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 HTTP/1.1 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:54:29.589769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:54:29.591046 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'd46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8'} Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:54:29.591783 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:54:29.593012 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:29.594542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:54:29.594542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-329950d7-2b24-43fc-87c9-79a7781369a4 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 404 len: 111 microversion: 2.1 time: 0.038002 Oct 19 13:54:29.594542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1523/2971] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:29 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:54:29.600697 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-54cdc3ac-c792-422b-a9da-9880ed8d8283 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '.version_select at 0x7ff4fc968d30>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:29.623450 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-54cdc3ac-c792-422b-a9da-9880ed8d8283 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797672646" status: 202 len: 0 microversion: 2.1 time: 0.026605 Oct 19 13:54:29.624000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1449/2972] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Oct 19 13:54:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797672646 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:54:30.317216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:30.317711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:30.323940 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.324440 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.324891 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.325579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.326048 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.326443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.563824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lazy-loading 'services' on Instance uuid 3f85d415-a454-4bd8-8230-f10c25bd5a40 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:54:30.643228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-68ac4e8d-f1c0-4845-8109-6c16bb7c134c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments/57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b" status: 202 len: 0 microversion: 2.1 time: 0.329918 Oct 19 13:54:30.643854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1524/2973] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:54:30 2022] DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments/57e1b51a-42e9-4b74-8cb6-6c8fa2e3db8b => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 13:54:30.652976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:30.655132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:30.662159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.662673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.663142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.663836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:30.664354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:30.664982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:30.696252 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-79c07e6d-66a1-4c84-8e46-d9c71ad5316b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047766 Oct 19 13:54:30.696813 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1450/2974] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:54:30 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:31.712794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:31.715553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:31.723516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.724003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.724468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.725177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.725632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.726055 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.756059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b83a90c9-dd24-4600-942e-f2c1937863e6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049357 Oct 19 13:54:31.756614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1525/2975] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:54:31 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:54:31.826312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:31.826801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:31.835763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.836635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.837422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.838614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.839360 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.840074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.869448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:54:31.954071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9d16b4ab-80ad-4a16-bbc0-b95b2a3934e7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 204 len: 0 microversion: 2.1 time: 0.131222 Oct 19 13:54:31.954771 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1451/2976] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:54:31 2022] DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:54:31.964200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:31.964755 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:31.971566 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.972057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.972473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:31.973179 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:31.973619 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:31.974033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:32.110764 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:32.119006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2e8513f4-1846-4ad4-b928-4c606d1ce347 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1680 microversion: 2.1 time: 0.159216 Oct 19 13:54:32.119615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1526/2977] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:31 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:33.155653 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:33.156921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:33.167890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:33.168663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:33.169448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:33.170587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:33.171290 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:33.171970 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:33.318177 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:33.326123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7bcdf4e1-736a-4055-a35c-9194e07cdd7a tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1680 microversion: 2.1 time: 0.177749 Oct 19 13:54:33.326665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1452/2978] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:33 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:34.350073 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:34.350652 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:34.357539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:34.358042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:34.358472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:34.359152 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:34.359663 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:34.360078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:34.426816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:34.440917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-97059cf7-c914-4190-85a5-21400f311e46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 200 len: 1615 microversion: 2.1 time: 0.094683 Oct 19 13:54:34.441804 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1527/2979] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:34 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:34.482718 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f85d415-a454-4bd8-8230-f10c25bd5a40", "name": "network-vif-deleted", "tag": "ac9a4fdc-5e9a-47b3-9a01-39153c373980"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:34.492817 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:34.493315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:34.493736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:34.505408 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] Creating event network-vif-deleted:ac9a4fdc-5e9a-47b3-9a01-39153c373980 for instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 on hv-cinder-maste Oct 19 13:54:34.510776 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-28107f73-06b4-40e7-adc9-bdbea3b37834 req-d7ebc9cc-a918-42a6-8f8a-ed719b6d2eae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031882 Oct 19 13:54:34.511993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1453/2980] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:35.463883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:35.464499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:35.472600 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:35.473115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:35.473598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:35.474322 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:35.474763 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:35.475194 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:35.489321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 HTTP/1.1 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:54:35.490994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:54:35.492441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '3f85d415-a454-4bd8-8230-f10c25bd5a40'} Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:54:35.493237 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:54:35.494537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:54:35.495810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:54:35.495810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a46568ca-3782-451f-a150-269606213627 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 404 len: 111 microversion: 2.1 time: 0.032495 Oct 19 13:54:35.496353 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1528/2981] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:35 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:54:35.502619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d4a430ac-c276-4d68-9ab4-30e88345a55e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '.version_select at 0x7ff4fc906c10>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:35.524745 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d4a430ac-c276-4d68-9ab4-30e88345a55e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228908587" status: 202 len: 0 microversion: 2.1 time: 0.026867 Oct 19 13:54:35.525342 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1454/2982] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Oct 19 13:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228908587 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:54:36.165761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: .version_select at 0x7ff4f9374b80>, body: {"keypair": {"name": "tempest-keypair-1788449944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQgGhkDRGdr4TsGGcLjcxjn10lJC1zNwnOZcqVmo6pstPVZsUZxau2jt9poiudM/KlHBGV/wsOjVqNefp32bYRqjPZh6Se98ApR6/7tWaUHDTlHTNSX/JWgMJeHhOCMfg=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:36.181856 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:54:36.186102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:54:36.198644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [3da70507-ea55-4498-a575-882e3d606eb7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:54:37.207641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [3da70507-ea55-4498-a575-882e3d606eb7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 36966. Oct 19 13:54:37.228552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a5145c20-aa0a-4e16-8afa-ece608800453 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.066700 Oct 19 13:54:37.229351 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1529/2983] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:54:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:38.487041 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1547817651", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60d117b1-c052-4c81-a285-bf6c947d79c2"}], "security_groups": [{"name": "tempest-securitygroup--653646050"}], "key_name": "tempest-keypair-1788449944", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:38.597919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] validate_networks() for [('60d117b1-c052-4c81-a285-bf6c947d79c2', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:54:38.975644 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:54:38.976055 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:54:38.976519 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:54:38.976919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:54:38.977343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:54:38.986871 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:38.987339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:38.987759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:38.988468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:38.988901 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:38.989343 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:39.006397 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:54:39.010476 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:54:39.022399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:54:39.024799 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:54:39.073341 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8c781af5-dae0-48a4-9450-74a447258a25 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590698 Oct 19 13:54:39.073986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1455/2984] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:54:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:54:39.086278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4f9fc941-3183-4381-a98e-54aa1916bdee tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:39.086896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4f9fc941-3183-4381-a98e-54aa1916bdee tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:39.141797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4f9fc941-3183-4381-a98e-54aa1916bdee tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:39.149341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4f9fc941-3183-4381-a98e-54aa1916bdee tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1242 microversion: 2.1 time: 0.067254 Oct 19 13:54:39.149952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1530/2985] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:39 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:40.173688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:40.174685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:40.182156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:40.182938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:40.183307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:40.184028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:40.184461 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:40.184891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:40.259365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:40.267329 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b6e35a70-3beb-4bee-acba-56afc31f53e5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1302 microversion: 2.1 time: 0.098858 Oct 19 13:54:40.268136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1456/2986] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:40 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:41.293359 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:41.294087 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:41.302947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:41.303445 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:41.304108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:41.305250 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:41.305924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:41.306672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:41.460513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:41.472333 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c02d0fc3-2269-4bd1-ade4-bee27cc4f262 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.183896 Oct 19 13:54:41.472975 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1531/2987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:41 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:41.977486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3830e21-a83a-4428-8c62-19793145375b", "tag": "a85f9f48-6445-4916-8033-38f2c2818cb3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:41.989147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:41.989741 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:41.990279 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:42.002700 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] Creating event network-changed:a85f9f48-6445-4916-8033-38f2c2818cb3 for instance d3830e21-a83a-4428-8c62-19793145375b on hv-cinder-maste Oct 19 13:54:42.007974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-df603933-6653-4c0f-9794-d22cee598705 req-0278f975-9291-4d12-a97f-0844b0d955d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034547 Oct 19 13:54:42.008755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1457/2988] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:42.499649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:42.500634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:42.508028 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:42.508438 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:42.508880 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:42.509601 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:42.510027 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:42.510447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:42.644349 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:42.652345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7b694b3d-2a48-4245-8bca-f28a28cad508 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.159251 Oct 19 13:54:42.652966 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1532/2989] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:42 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:43.676594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:43.677200 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:43.683863 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:43.684339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:43.684761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:43.685479 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:43.685914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:43.686325 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:43.819867 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:43.828096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9566aec9-19b4-4b0f-9fef-08df92535f4c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.156456 Oct 19 13:54:43.828660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1458/2990] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:43 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:44.862481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:44.863507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:44.874702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:44.875533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:44.876222 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:44.877834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:44.878291 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:44.878717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:45.016831 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:45.028200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cc0c5c86-421c-41a1-aa50-b0c9533991e1 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.173109 Oct 19 13:54:45.028990 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1533/2991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:44 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:46.056288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:46.057285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:46.068266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:46.069104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:46.069812 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:46.070936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:46.071896 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:46.072585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:46.206814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:46.214628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a192ad1a-7b33-4dab-96ad-e02212fec24b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.165198 Oct 19 13:54:46.215197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1459/2992] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:46 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:47.242642 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:47.243493 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:47.253737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:47.254205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:47.254659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:47.255345 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:47.255795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:47.256213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:47.396264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:47.404319 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-28ff626e-d143-4912-9eab-f63cbd73bde8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.168862 Oct 19 13:54:47.404926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1534/2993] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:47 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:48.321292 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3830e21-a83a-4428-8c62-19793145375b", "name": "network-vif-plugged", "status": "completed", "tag": "a85f9f48-6445-4916-8033-38f2c2818cb3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:48.332331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:48.332794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:48.333238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:48.347729 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] Creating event network-vif-plugged:a85f9f48-6445-4916-8033-38f2c2818cb3 for instance d3830e21-a83a-4428-8c62-19793145375b on hv-cinder-maste Oct 19 13:54:48.352854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-bf51ebb4-852d-4d26-bf81-3e4c7e73eb9a req-cf8957fc-3788-4f39-9e99-e16276a81f45 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093208 Oct 19 13:54:48.353534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1460/2994] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:48.427706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:48.428338 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:48.434857 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:48.435344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:48.435773 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:48.436468 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:48.436945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:48.437369 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:48.570473 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:48.579259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2b6743ed-d0ce-403f-819e-81e2e67deecc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1367 microversion: 2.1 time: 0.156103 Oct 19 13:54:48.579885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1535/2995] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:48 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:49.603711 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:49.604442 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:49.606638 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:49.607320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=6 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:49.613831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:49.614311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:49.614746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:49.615434 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:49.615879 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:49.616296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:49.755657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:54:49.763730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c82f86a1-acfe-4cb0-a1ca-c04bbdb58ebc tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1558 microversion: 2.1 time: 0.164361 Oct 19 13:54:49.764331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1461/2996] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:54:49 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:54:49.785977 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:54:49.786483 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:54:49.788425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:54:49.794620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:49.795095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:49.795527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:49.796202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:49.796647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:49.797095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:49.883991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5de31927-2c76-4815-9ef8-a8b1829dd419 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101947 Oct 19 13:54:49.885497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1536/2997] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:54:49 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:54:50.844078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3830e21-a83a-4428-8c62-19793145375b", "tag": "a85f9f48-6445-4916-8033-38f2c2818cb3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:54:50.855814 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:54:50.856364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:54:50.856897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:54:50.868625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] Creating event network-changed:a85f9f48-6445-4916-8033-38f2c2818cb3 for instance d3830e21-a83a-4428-8c62-19793145375b on hv-cinder-maste Oct 19 13:54:50.873679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-f1e30418-ff5b-41ed-9dbe-affa25e8b3cc req-a7255fae-f53d-4717-bf12-a73061ba20f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Oct 19 13:54:50.874449 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1462/2998] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:20.178499 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:20.179989 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:20.184971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:20.188126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:20.189331 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:20.189722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:20.201796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:20.202500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:20.203184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:20.204085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:20.204824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:20.205352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:20.232197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:55:20.249592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f0ee62-0b59-497a-9146-0bb0aa1d904d", "tag": "b8e230d6-2a88-4008-8bd3-aaa15c7d8228"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:20.261890 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:20.262504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:20.263167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:20.276624 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] Creating event network-changed:b8e230d6-2a88-4008-8bd3-aaa15c7d8228 for instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d on hv-cinder-maste Oct 19 13:55:20.282137 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-2bd6a3bf-42ca-4794-a733-bbebcca58039 req-2c85acf4-c095-4637-9300-8e31caf865e3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102053 Oct 19 13:55:20.283694 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1463/2999] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:20.322588 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ad06a08e-f240-49ff-827e-718328fa53ba tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 204 len: 0 microversion: 2.1 time: 0.144866 Oct 19 13:55:20.323883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1537/3000] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:55:20 2022] DELETE /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:55:20.332747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:20.333794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:20.341949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:20.342925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:20.343679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:20.345132 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:20.345662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:20.346333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:20.481627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:20.489754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5ae68a05-38b4-4391-b255-2e5f36b2e311 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1578 microversion: 2.1 time: 0.161572 Oct 19 13:55:20.490336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1464/3001] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:20 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 13:55:21.513926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:21.514638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:21.521513 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:21.522022 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:21.522463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:21.523162 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:21.523616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:21.524045 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:21.665536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:21.673704 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75787677-91a4-4f8e-9e0a-07d76f13cd53 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1578 microversion: 2.1 time: 0.164065 Oct 19 13:55:21.674258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1538/3002] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:21 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:22.364623 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f0ee62-0b59-497a-9146-0bb0aa1d904d", "name": "network-vif-deleted", "tag": "b8e230d6-2a88-4008-8bd3-aaa15c7d8228"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:22.374881 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:22.375433 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:22.375852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:22.387858 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] Creating event network-vif-deleted:b8e230d6-2a88-4008-8bd3-aaa15c7d8228 for instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d on hv-cinder-maste Oct 19 13:55:22.393833 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-fe0111f7-af91-4219-9c16-e5eb0f3da38a req-1014baa6-d6a2-4be6-bc69-b47720225a27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Oct 19 13:55:22.394414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1465/3003] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:22.699631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:22.700127 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:22.708548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:22.709107 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:22.709739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:22.710596 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:22.711216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:22.711784 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:22.750686 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:22.751336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:22.751904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:22.752481 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lazy-loading 'fault' on Instance uuid f4f0ee62-0b59-497a-9146-0bb0aa1d904d {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:55:22.798350 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:22.806449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ddb328cc-5eea-4009-991e-337cdc52abc4 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 200 len: 1230 microversion: 2.1 time: 0.113266 Oct 19 13:55:22.807016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1539/3004] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:22 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:23.830854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:23.831561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: f4f0ee62-0b59-497a-9146-0bb0aa1d904d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:23.838403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:23.838880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:23.839307 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:23.839983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:23.840423 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:23.840844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:23.854628 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] HTTP exception thrown: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Request method failure captured: Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d HTTP/1.1 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUABEqg9jJiufzNmaC8R2C4TPNcktkyTKqm4k6b7YR38qxg7mb_9becresQq_WBifEqM1nO_meD1FTYHnR2gNoOv0OOYg6bY6Mr7uLEqfPas-CbXea2F14pKMW-IaYKoeiDNJc1r6csSti1YGdHdhfuPow5tO73cYWS4t30BzUO5PKT4 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:55:23.856241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3a0f0cc24374aeebc0b023e4a79a5de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ad89cdd33ea645d8948465fe0c88a695 Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. Oct 19 13:55:23.857736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'f4f0ee62-0b59-497a-9146-0bb0aa1d904d'} Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:23.858448 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. Oct 19 13:55:23.859540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:23.860601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Returning 404 to user: Instance f4f0ee62-0b59-497a-9146-0bb0aa1d904d could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:23.860601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-17fffd0f-7953-4528-aa79-09b913269100 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d" status: 404 len: 111 microversion: 2.1 time: 0.031527 Oct 19 13:55:23.860601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1466/3005] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:23 2022] GET /compute/v2.1/servers/f4f0ee62-0b59-497a-9146-0bb0aa1d904d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:55:26.976692 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:26.985023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:27.003849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.004616 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.004961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.005662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.006301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.006717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.007097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:27.007571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:27.014702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.015561 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.016666 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.017828 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.018418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.018995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.032902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-041af0c2-61f2-49e2-a68e-e2bb48c3e44c tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/ips" status: 200 len: 150 microversion: 2.1 time: 0.060061 Oct 19 13:55:27.033849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1540/3006] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:55:26 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:27.038209 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f087e4e-f0e4-4884-ae7b-78ca70b8b435", "tag": "d67a113c-935b-4a84-b9ad-152551d32c1b"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:27.048751 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.049383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.049816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.050730 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:55:27.064613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] Creating event network-changed:d67a113c-935b-4a84-b9ad-152551d32c1b for instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 on hv-cinder-maste Oct 19 13:55:27.070754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-09f09143-944a-448c-9eaa-ee836115a1ca req-b39d001e-8ef2-4ae2-9e23-bc42368bae50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035015 Oct 19 13:55:27.071792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1541/3007] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:27.159726 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-271d1d86-01de-4f50-98b4-45385289625a tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 204 len: 0 microversion: 2.1 time: 0.152543 Oct 19 13:55:27.160837 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1467/3008] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:55:27 2022] DELETE /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 13:55:27.170734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:27.171621 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:27.178924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.179485 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.180147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.181070 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:27.181697 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:27.182362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:27.365938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:27.379732 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-dfa95768-815b-442e-a1ad-bc408afe700e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1574 microversion: 2.1 time: 0.214510 Oct 19 13:55:27.394327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1542/3009] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:27 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:28.407764 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:28.408462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:28.415595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:28.415918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:28.416736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:28.417232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:28.418583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:28.418583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:28.481904 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1995749e-5841-4096-91d3-67f74a475ffc"}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:28.484281 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:28.490847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:28.491334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:28.491908 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:28.492615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:28.493108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:28.493536 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:28.557345 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:28.565324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c2b6c94b-2b7b-444c-8718-d2266b9b431e tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1574 microversion: 2.1 time: 0.161769 Oct 19 13:55:28.565888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1468/3010] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:28 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:28.755612 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-853c5fff-fa9d-4334-9868-713f2a60469d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277743 Oct 19 13:55:28.756399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1543/3011] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:55:28 2022] POST /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:29.153103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f087e4e-f0e4-4884-ae7b-78ca70b8b435", "name": "network-vif-deleted", "tag": "d67a113c-935b-4a84-b9ad-152551d32c1b"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:29.163176 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:29.163794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:29.164165 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:29.189839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] Creating event network-vif-deleted:d67a113c-935b-4a84-b9ad-152551d32c1b for instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 on hv-cinder-maste Oct 19 13:55:29.195536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-4905f0fa-42ca-473d-95c7-a2a82deb1965 req-3aebdfaf-3100-4b2a-9c7d-9d6882a12446 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046444 Oct 19 13:55:29.196123 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1469/3012] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:29.593021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:29.593650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:29.600766 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:29.601284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:29.601717 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:29.602399 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:29.602838 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:29.603252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:29.633603 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:29.634080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:29.634510 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:29.635066 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lazy-loading 'fault' on Instance uuid 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:55:29.683467 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad89cdd33ea645d8948465fe0c88a695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a0f0cc24374aeebc0b023e4a79a5de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:29.692009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b2371cbb-aa87-4aad-9b93-46ef6edbcbdf tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 200 len: 1229 microversion: 2.1 time: 0.103926 Oct 19 13:55:29.692614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1544/3013] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:29 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:30.719028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:30.719891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 3f087e4e-f0e4-4884-ae7b-78ca70b8b435] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:30.727995 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:30.728619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:30.729749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:30.730429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:30.730882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:30.731298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:30.745067 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] HTTP exception thrown: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Request method failure captured: Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 HTTP/1.1 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUABEqg9jJiufzNmaC8R2C4TPNcktkyTKqm4k6b7YR38qxg7mb_9becresQq_WBifEqM1nO_meD1FTYHnR2gNoOv0OOYg6bY6Mr7uLEqfPas-CbXea2F14pKMW-IaYKoeiDNJc1r6csSti1YGdHdhfuPow5tO73cYWS4t30BzUO5PKT4 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:55:30.746682 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3a0f0cc24374aeebc0b023e4a79a5de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ad89cdd33ea645d8948465fe0c88a695 Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. Oct 19 13:55:30.748023 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '3f087e4e-f0e4-4884-ae7b-78ca70b8b435'} Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:30.748780 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. Oct 19 13:55:30.750127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:30.751268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Returning 404 to user: Instance 3f087e4e-f0e4-4884-ae7b-78ca70b8b435 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:30.751268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bb163c91-01b0-46d4-ad42-21a9aaf1c0f2 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435" status: 404 len: 111 microversion: 2.1 time: 0.035642 Oct 19 13:55:30.751268 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1470/3014] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:30 2022] GET /compute/v2.1/servers/3f087e4e-f0e4-4884-ae7b-78ca70b8b435 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:55:31.195709 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:31.196243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:31.203434 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:31.203920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:31.204387 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:31.205090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:31.205545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:31.205974 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:31.219874 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] HTTP exception thrown: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Request method failure captured: Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 HTTP/1.1 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUABEqg9jJiufzNmaC8R2C4TPNcktkyTKqm4k6b7YR38qxg7mb_9becresQq_WBifEqM1nO_meD1FTYHnR2gNoOv0OOYg6bY6Mr7uLEqfPas-CbXea2F14pKMW-IaYKoeiDNJc1r6csSti1YGdHdhfuPow5tO73cYWS4t30BzUO5PKT4 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:55:31.221638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3a0f0cc24374aeebc0b023e4a79a5de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: ad89cdd33ea645d8948465fe0c88a695 Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.223124 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '62fb78bd-9228-4d86-bd9c-a35cccc53e81'} Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:31.223913 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.225254 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.226659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Returning 404 to user: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:31.226659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4d63c71d-cdfd-43c3-991f-c3aeca2d89fb tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "DELETE /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 404 len: 111 microversion: 2.1 time: 0.031315 Oct 19 13:55:31.226659 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1545/3015] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:55:31 2022] DELETE /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:55:31.232094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:31.232709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] [instance: 62fb78bd-9228-4d86-bd9c-a35cccc53e81] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:31.239139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:31.239621 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:31.240090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:31.240779 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:31.241318 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:31.241740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:31.257060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] HTTP exception thrown: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Request method failure captured: Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 HTTP/1.1 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUABEqg9jJiufzNmaC8R2C4TPNcktkyTKqm4k6b7YR38qxg7mb_9becresQq_WBifEqM1nO_meD1FTYHnR2gNoOv0OOYg6bY6Mr7uLEqfPas-CbXea2F14pKMW-IaYKoeiDNJc1r6csSti1YGdHdhfuPow5tO73cYWS4t30BzUO5PKT4 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:55:31.258615 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c3a0f0cc24374aeebc0b023e4a79a5de", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c3a0f0cc24374aeebc0b023e4a79a5de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c3a0f0cc24374aeebc0b023e4a79a5de Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestVolumeBootPattern-1886376917 Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: ad89cdd33ea645d8948465fe0c88a695 Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestVolumeBootPattern-1886376917-project Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.260072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '62fb78bd-9228-4d86-bd9c-a35cccc53e81'} Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:31.260820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. Oct 19 13:55:31.262120 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:31.263196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Returning 404 to user: Instance 62fb78bd-9228-4d86-bd9c-a35cccc53e81 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:31.263196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-45139397-dd8e-4d48-bb12-aa40263754af tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81" status: 404 len: 111 microversion: 2.1 time: 0.031993 Oct 19 13:55:31.263196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1471/3016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:31 2022] GET /compute/v2.1/servers/62fb78bd-9228-4d86-bd9c-a35cccc53e81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:55:32.570039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-652a0b7e-286a-49d1-8064-8c6c162c4c51 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] Calling method '.version_select at 0x7ff4f93443a0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:32.593958 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-652a0b7e-286a-49d1-8064-8c6c162c4c51 tempest-TestVolumeBootPattern-1886376917 tempest-TestVolumeBootPattern-1886376917-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-694965556" status: 202 len: 0 microversion: 2.1 time: 0.027828 Oct 19 13:55:32.594533 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1546/3017] 10.222.0.17 () {58 vars in 1260 bytes} [Wed Oct 19 13:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-694965556 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:55:35.272568 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1995749e-5841-4096-91d3-67f74a475ffc"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:35.274929 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:35.281566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.282039 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.282539 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.283223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.283662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.284071 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.370619 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: POST /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments HTTP/1.1 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 74 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:55:35.374251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {"volumeAttachment": {"volumeId": "1995749e-5841-4096-91d3-67f74a475ffc"}} Oct 19 13:55:35.375412 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'server_id': 'd3830e21-a83a-4428-8c62-19793145375b', 'body': {'volumeAttachment': {'volumeId': '1995749e-5841-4096-91d3-67f74a475ffc'}}} Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:35.376056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:35.377104 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 400 to user: Invalid volume: volume 1995749e-5841-4096-91d3-67f74a475ffc is already attached to instances: d3830e21-a83a-4428-8c62-19793145375b {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2163f76f-86a1-4133-9fb1-7ab95043ed4e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107215 Oct 19 13:55:35.378198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1472/3018] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:55:35 2022] POST /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:55:35.453305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:35.453955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:35.461167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.461912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.462511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.463231 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.463693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.464117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.555965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lazy-loading 'services' on Instance uuid d3830e21-a83a-4428-8c62-19793145375b {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:55:35.697675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7ef0878b-ac76-46c9-bd72-f7808601bb58 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments/1995749e-5841-4096-91d3-67f74a475ffc" status: 202 len: 0 microversion: 2.1 time: 0.248795 Oct 19 13:55:35.698828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1547/3019] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:55:35 2022] DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments/1995749e-5841-4096-91d3-67f74a475ffc => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:55:35.707800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:35.714614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:35.722030 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.722882 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.723548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.724415 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:35.725074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:35.725665 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:35.774157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-eb2fefff-23a2-4068-914e-b3bb4607b966 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070464 Oct 19 13:55:35.774725 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1473/3020] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:55:35 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:36.788449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:36.791437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:36.799889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:36.800403 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:36.800777 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:36.801690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:36.802115 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:36.802710 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:36.833896 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bf4f38dc-91c6-4678-b9ae-755833bd42c2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049600 Oct 19 13:55:36.834364 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1548/3021] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:55:36 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:55:36.900156 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:36.900660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:36.908143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:36.908667 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:36.909174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:36.909834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:36.910455 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:36.910875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:36.939361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:55:37.031310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e32fdac3-7c44-4df3-afe8-03fa3026a026 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 204 len: 0 microversion: 2.1 time: 0.134931 Oct 19 13:55:37.032298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1474/3022] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:55:36 2022] DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:55:37.040683 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:37.041589 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:37.049743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:37.050239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:37.050675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:37.051381 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:37.052009 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:37.052575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:37.271518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:37.280537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-266dea01-5ba5-4464-8615-c844beaace20 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1682 microversion: 2.1 time: 0.243886 Oct 19 13:55:37.281236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1549/3023] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:37 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:38.304936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:38.305634 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:38.312251 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:38.312737 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:38.313195 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:38.313884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:38.314346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:38.314736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:38.458107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:38.467066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a32a7bc9-9fd2-4a8a-b214-c9fc6c5585a6 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1682 microversion: 2.1 time: 0.166600 Oct 19 13:55:38.468333 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1475/3024] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:38 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:39.491610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:39.492277 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:39.500105 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:39.500912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:39.501558 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:39.502722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:39.503090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:39.503607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:39.600744 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:39.620823 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bd9d86d7-17b5-426c-8f81-82f7ed647614 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 200 len: 1615 microversion: 2.1 time: 0.133322 Oct 19 13:55:39.623367 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1550/3025] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:39 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 1615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:39.723157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3830e21-a83a-4428-8c62-19793145375b", "name": "network-vif-deleted", "tag": "a85f9f48-6445-4916-8033-38f2c2818cb3"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:39.734181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:39.734660 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:39.735133 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:39.749866 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] Creating event network-vif-deleted:a85f9f48-6445-4916-8033-38f2c2818cb3 for instance d3830e21-a83a-4428-8c62-19793145375b on hv-cinder-maste Oct 19 13:55:39.755327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-28aabc32-fc6e-407e-9276-07f14cc09381 req-50a92153-2725-46f1-a671-cadfc2947f2e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035740 Oct 19 13:55:39.756231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1476/3026] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:40.645788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:40.646489 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:40.655509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:40.656213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:40.656661 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:40.657435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:40.657885 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:40.658320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:40.683772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b HTTP/1.1 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:55:40.685858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:55:40.687324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'd3830e21-a83a-4428-8c62-19793145375b'} Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:55:40.688128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:55:40.689446 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:55:40.690561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:55:40.690561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6175c681-9af2-452a-80f6-4677d18484cd tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 404 len: 111 microversion: 2.1 time: 0.046027 Oct 19 13:55:40.690561 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1551/3027] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:40 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:55:40.699805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7b4b2e07-8807-4faf-8beb-925c9f077db7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '.version_select at 0x7ff4f92285e0>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:40.722777 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7b4b2e07-8807-4faf-8beb-925c9f077db7 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788449944" status: 202 len: 0 microversion: 2.1 time: 0.029162 Oct 19 13:55:40.723463 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1477/3028] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Oct 19 13:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788449944 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:55:41.703238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b3465552-057e-446d-a695-c9e7cba920ca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: .version_select at 0x7ff4f9372a60>, body: {"keypair": {"name": "tempest-keypair-921782530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM07ZATe+yt7Zj6v7mnAUU7Fk9aqrMf24wNy3MPOIc4UXMCEu40y+lj42xL7Ql+LR33UlfOjy3PcRSosINV2dEedrIrpOjPaCet/Vhyrsm0vVTJapvRFuFE9F9C+gkcGSA=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:41.720431 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-b3465552-057e-446d-a695-c9e7cba920ca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:55:41.724393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-b3465552-057e-446d-a695-c9e7cba920ca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:55:41.749304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b3465552-057e-446d-a695-c9e7cba920ca tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050334 Oct 19 13:55:41.749922 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1552/3029] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:55:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:43.055286 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-438748417", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60d117b1-c052-4c81-a285-bf6c947d79c2"}], "security_groups": [{"name": "tempest-securitygroup--1248659205"}], "key_name": "tempest-keypair-921782530", "user_data": "}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:43.345862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] validate_networks() for [('60d117b1-c052-4c81-a285-bf6c947d79c2', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:55:43.743831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:55:43.744244 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:55:43.744735 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:55:43.745149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:55:43.745549 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:55:43.755266 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:43.755664 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:43.756078 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:43.756781 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:43.757246 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:43.757663 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:43.774689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:55:43.779047 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Getting quotas for user 43d5beeaa1204d22b3ad9ffab6a69417 and project 0745acac5aad45fc8355a03bf8abc8c7. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:55:43.790690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:55:43.793092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:55:43.841905 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4685dd2e-076f-4f86-9d5e-4b9f7f3a4aa3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.791107 Oct 19 13:55:43.842524 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1478/3030] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:55:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:55:43.854135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a312c78c-91c6-410c-a397-540fa72ff9b8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:43.854851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a312c78c-91c6-410c-a397-540fa72ff9b8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:43.913214 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a312c78c-91c6-410c-a397-540fa72ff9b8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:43.920354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a312c78c-91c6-410c-a397-540fa72ff9b8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1240 microversion: 2.1 time: 0.070310 Oct 19 13:55:43.920948 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1553/3031] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:43 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:44.943304 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:44.944127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:44.952035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:44.952581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:44.953038 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:44.953724 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:44.954198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:44.954609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:45.029019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:45.037098 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b75b48ab-b58f-4066-a9cd-dd7a34928dc2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1310 microversion: 2.1 time: 0.097771 Oct 19 13:55:45.037691 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1479/3032] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:44 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:46.060452 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:46.061071 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:46.068494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:46.069133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:46.069570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:46.070270 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:46.070714 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:46.071133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:46.090810 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:46.205053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:46.212811 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8a17ea8c-c143-4ae0-af9a-181f7f09cd47 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1366 microversion: 2.1 time: 0.156716 Oct 19 13:55:46.213516 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1554/3033] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:46 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:46.316532 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac928163-1efe-4f27-8df3-f1dc8b603f45", "tag": "21abfcb3-a06a-4e10-91f9-d9c3e3893dc4"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:46.336209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:46.336993 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:46.337573 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:46.354910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] Creating event network-changed:21abfcb3-a06a-4e10-91f9-d9c3e3893dc4 for instance ac928163-1efe-4f27-8df3-f1dc8b603f45 on hv-cinder-maste Oct 19 13:55:46.370390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-df0946b5-e462-4c08-98de-cc945b85916e req-f6e8f9c0-e4c6-472f-b94e-d956b7966da4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064258 Oct 19 13:55:46.370983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1480/3034] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:47.240331 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:47.241410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:47.251132 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:47.251691 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:47.252206 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:47.253042 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:47.253568 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:47.254059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:47.398236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:47.406410 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c049e277-30e8-4d38-b254-d7284f6bc843 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1366 microversion: 2.1 time: 0.172581 Oct 19 13:55:47.407205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1555/3035] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:47 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:48.429893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:48.432198 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:48.438893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:48.439381 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:48.439805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:48.440485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:48.441147 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:48.441566 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:48.577414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:48.585363 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-826e0171-eba8-46d6-bc71-e7e58254a1e2 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1366 microversion: 2.1 time: 0.160512 Oct 19 13:55:48.586010 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1481/3036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:48 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:49.612606 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:49.613494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:49.623723 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:49.624198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:49.624604 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:49.625355 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:49.625798 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:49.626218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:49.754915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:49.765515 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e80d2f40-425a-49fe-9567-fc0190b62361 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1366 microversion: 2.1 time: 0.159545 Oct 19 13:55:49.766054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1556/3037] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:49 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:50.678076 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac928163-1efe-4f27-8df3-f1dc8b603f45", "name": "network-vif-plugged", "status": "completed", "tag": "21abfcb3-a06a-4e10-91f9-d9c3e3893dc4"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:50.684226 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:50.691897 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:50.692403 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:50.692942 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:50.696119 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:50.707289 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] Creating event network-vif-plugged:21abfcb3-a06a-4e10-91f9-d9c3e3893dc4 for instance ac928163-1efe-4f27-8df3-f1dc8b603f45 on hv-cinder-maste Oct 19 13:55:50.712320 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-f199ff3d-fd66-4980-a9e0-cc0a8a45e1db req-2f97124d-62b5-4995-8a9e-15199f8101ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038152 Oct 19 13:55:50.713125 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1482/3038] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:50.797474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:50.798117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:50.802104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:55:50.806098 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:50.806620 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:50.807060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:50.807861 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:50.808509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:50.809305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:50.947118 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:50.955252 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-14e9d3bc-be91-490f-bea3-af52b4fd80cf tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1366 microversion: 2.1 time: 0.162075 Oct 19 13:55:50.955833 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1557/3039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:50 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:51.984592 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:51.986014 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:51.999520 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:51.999994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:52.000419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:52.001130 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:52.001570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:52.001980 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:52.141688 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:55:52.150051 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-bd910d80-49fd-42ff-8ee0-479cda032232 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1557 microversion: 2.1 time: 0.174093 Oct 19 13:55:52.150622 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1483/3040] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:55:51 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:55:52.173001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:55:52.173518 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:55:52.182245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:52.183003 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:52.183646 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:52.184713 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:52.185379 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:52.185998 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:52.273306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2d579c72-0d25-4111-8c05-b4a709914b1b tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104829 Oct 19 13:55:52.273912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1558/3041] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Oct 19 13:55:52 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:55:53.223148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac928163-1efe-4f27-8df3-f1dc8b603f45", "tag": "21abfcb3-a06a-4e10-91f9-d9c3e3893dc4"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:55:53.233645 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:55:53.234196 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:55:53.234687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:55:53.245883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] Creating event network-changed:21abfcb3-a06a-4e10-91f9-d9c3e3893dc4 for instance ac928163-1efe-4f27-8df3-f1dc8b603f45 on hv-cinder-maste Oct 19 13:55:53.251274 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-1ec213ff-1a0a-4f14-a1f9-251f10ee5e1a req-549d8f1c-2714-4fbe-be21-d9e8c554aa0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031914 Oct 19 13:55:53.252206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1484/3042] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:29.061377 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:29.062797 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:29.063863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=24 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:29.069793 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:29.070286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:29.077702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:29.078191 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:29.078613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:29.079300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:29.079748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:29.080167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:29.106167 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c70fec32-0727-40f1-aec0-068b38006b73 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/ips" status: 200 len: 151 microversion: 2.1 time: 0.047281 Oct 19 13:56:29.106737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1559/3043] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:56:29 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:30.458924 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.459820 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=6 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.461129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=5 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.461721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=9 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:56:30.466265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd6f1ba-c0cd-4525-ac68-c0c7cb7e2314"}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:30.468657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:30.476891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.477354 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.477785 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.478459 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:30.478903 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:30.479315 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:30.757950 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b4ae20ca-8c74-4caa-9091-452c05bb52ff tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "POST /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299608 Oct 19 13:56:30.758546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1485/3044] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Oct 19 13:56:30 2022] POST /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:37.414942 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:37.415477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:37.422158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:37.422634 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:37.423067 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:37.423748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:37.424197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:37.424613 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:37.509147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lazy-loading 'services' on Instance uuid ac928163-1efe-4f27-8df3-f1dc8b603f45 {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 13:56:37.593352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2acacb9c-7326-4a11-98a6-cc417a7ac234 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments/fdd6f1ba-c0cd-4525-ac68-c0c7cb7e2314" status: 202 len: 0 microversion: 2.1 time: 0.182148 Oct 19 13:56:37.593946 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1560/3045] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Oct 19 13:56:37 2022] DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments/fdd6f1ba-c0cd-4525-ac68-c0c7cb7e2314 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:56:37.604043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:37.606543 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:37.613398 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:37.613883 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:37.614353 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:37.615068 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:37.615516 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:37.615949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:37.651921 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c95b41ce-4a6c-4789-92d5-c9bdf9a0bf27 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052911 Oct 19 13:56:37.652493 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1486/3046] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:56:37 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 13:56:38.671059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:38.674792 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:38.684971 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.685453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.685889 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:38.686577 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.687315 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.687718 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:38.718325 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b16b59d4-5a81-41e5-88ef-6fb43db9e356 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055605 Oct 19 13:56:38.718917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1561/3047] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Oct 19 13:56:38 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 13:56:38.789775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:38.790302 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:38.797114 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.797584 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.798009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:38.798685 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.799129 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.799538 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:38.825647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:56:38.908542 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-9caabea4-c4be-4496-9e4f-958b5c546083 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 204 len: 0 microversion: 2.1 time: 0.122451 Oct 19 13:56:38.909191 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1487/3048] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:38 2022] DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:56:38.917476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:38.918128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:38.924177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.924585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.925057 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:38.925734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:38.926177 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:38.926592 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:39.068448 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:39.076702 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bdce0174-986d-4df7-8328-c31a524aab5d tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1682 microversion: 2.1 time: 0.163161 Oct 19 13:56:39.077303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1562/3049] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:38 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:40.104558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:40.105746 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:40.116571 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:40.117419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:40.118138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:40.119262 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:40.120007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:40.120699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:40.532298 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:40.540468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4394fe3f-5755-4c8d-9d08-7a006fa864d5 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1682 microversion: 2.1 time: 0.442998 Oct 19 13:56:40.541063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1488/3050] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:40 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1682 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:41.567795 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:41.568336 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:41.575240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:41.575920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:41.576502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:41.577492 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:41.577952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:41.578423 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:41.642906 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d5beeaa1204d22b3ad9ffab6a69417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0745acac5aad45fc8355a03bf8abc8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:56:41.651970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-33e71bb4-f768-487c-a1ad-28ae72229ccb tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 200 len: 1614 microversion: 2.1 time: 0.088095 Oct 19 13:56:41.652949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1563/3051] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:41 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:56:41.690755 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac928163-1efe-4f27-8df3-f1dc8b603f45", "name": "network-vif-deleted", "tag": "21abfcb3-a06a-4e10-91f9-d9c3e3893dc4"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:56:41.702790 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:41.703481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:41.704698 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:41.717069 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] Creating event network-vif-deleted:21abfcb3-a06a-4e10-91f9-d9c3e3893dc4 for instance ac928163-1efe-4f27-8df3-f1dc8b603f45 on hv-cinder-maste Oct 19 13:56:41.721910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-ea9a98b7-e1cc-4e2d-a6b1-b25ededf0b0d req-37c4a999-fa0b-4aff-9340-f86bb7078d78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035312 Oct 19 13:56:41.722508 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1489/3052] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:56:42.675511 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:42.676121 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:42.682828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:42.683917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:42.684365 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:42.685112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:42.685733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:42.686153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:42.700938 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 HTTP/1.1 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:56:42.702639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:42.704128 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'ac928163-1efe-4f27-8df3-f1dc8b603f45'} Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:42.705021 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:42.706402 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:42.707598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:42.707598 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-894aa15a-8db8-4b87-ba9b-3103c60cc68f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 404 len: 111 microversion: 2.1 time: 0.032511 Oct 19 13:56:42.708062 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1564/3053] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:42 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:42.713994 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-018dd23f-5850-4e08-aa84-2f6c23f395ec tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '.version_select at 0x7ff4fc98d0d0>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:42.736091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-018dd23f-5850-4e08-aa84-2f6c23f395ec tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921782530" status: 202 len: 0 microversion: 2.1 time: 0.026847 Oct 19 13:56:42.736671 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1490/3054] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Oct 19 13:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921782530 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:56:44.501297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:44.501902 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:44.508695 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:44.509233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:44.509673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:44.510370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:44.510826 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:44.511392 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:44.525020 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 HTTP/1.1 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:56:44.526538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.527875 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'ac928163-1efe-4f27-8df3-f1dc8b603f45'} Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:44.528645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.529932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.531225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:44.531225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a6e5a1e9-fc5e-46bb-bd14-7b192f8a63a3 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 404 len: 111 microversion: 2.1 time: 0.030717 Oct 19 13:56:44.531225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1565/3055] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:44 2022] DELETE /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:44.537034 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:44.537774 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: ac928163-1efe-4f27-8df3-f1dc8b603f45] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:44.544485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:44.545094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:44.545528 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:44.546204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:44.546647 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:44.547061 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:44.560241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 HTTP/1.1 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:56:44.561920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.563339 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'ac928163-1efe-4f27-8df3-f1dc8b603f45'} Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:44.565211 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. Oct 19 13:56:44.566510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:44.567578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance ac928163-1efe-4f27-8df3-f1dc8b603f45 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:44.567578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-904c5a8a-d4e8-42d8-a342-bd0c2452dce8 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45" status: 404 len: 111 microversion: 2.1 time: 0.030673 Oct 19 13:56:44.567578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1491/3056] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:44 2022] GET /compute/v2.1/servers/ac928163-1efe-4f27-8df3-f1dc8b603f45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:45.718645 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:45.719150 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:45.726135 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.726693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.727203 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.727967 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.728491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.728949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.744627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b HTTP/1.1 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:56:45.746258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.747949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'd3830e21-a83a-4428-8c62-19793145375b'} Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:45.748706 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.749794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.751051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:45.751051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-bc72a6d1-d960-4841-9dc2-fe5ec37e891e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 404 len: 111 microversion: 2.1 time: 0.034137 Oct 19 13:56:45.751051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1566/3057] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:45 2022] DELETE /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:45.757204 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:45.757809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d3830e21-a83a-4428-8c62-19793145375b] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:45.764719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.765223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.765648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.766323 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.766761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.767173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.782906 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b HTTP/1.1 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:56:45.784456 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.785803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'd3830e21-a83a-4428-8c62-19793145375b'} Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:45.786595 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. Oct 19 13:56:45.787918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.789103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d3830e21-a83a-4428-8c62-19793145375b could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:45.789103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-90aaf8f8-5162-4713-afa5-dac4ad202d23 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b" status: 404 len: 111 microversion: 2.1 time: 0.032582 Oct 19 13:56:45.789103 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1492/3058] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:45 2022] GET /compute/v2.1/servers/d3830e21-a83a-4428-8c62-19793145375b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:45.794757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:45.795243 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:45.801401 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.801818 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.802246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.803059 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.803547 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.803961 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.817796 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 HTTP/1.1 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:56:45.819321 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.820767 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': 'd46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8'} Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:45.821673 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.822759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.823805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:45.823805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-e374e98e-1d7d-4b8b-8b9a-72c2ea946a46 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 404 len: 111 microversion: 2.1 time: 0.029959 Oct 19 13:56:45.823805 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1567/3059] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:45 2022] DELETE /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:45.829306 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:45.829915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:45.835940 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.836418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.836847 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.837558 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:45.838009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:45.838425 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:45.852371 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 HTTP/1.1 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:56:45.853919 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.855404 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': 'd46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8'} Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:45.856757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. Oct 19 13:56:45.858149 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:45.859462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:45.859462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f76dd893-4877-4f66-8643-ffd176fa6c02 tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8" status: 404 len: 111 microversion: 2.1 time: 0.030124 Oct 19 13:56:45.859462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1493/3060] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:45 2022] GET /compute/v2.1/servers/d46bb4ea-d7ef-4938-9ca7-de9cb7af1ca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:47.004654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:47.005190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:47.011540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:47.012031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:47.012486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:47.013247 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:47.013696 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:47.014097 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:47.027747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 HTTP/1.1 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:56:47.029412 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.030771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '3f85d415-a454-4bd8-8230-f10c25bd5a40'} Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:47.031570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.034249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:47.034249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-21d31af1-9381-4e04-afa1-5d3b4951457f tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 404 len: 111 microversion: 2.1 time: 0.030183 Oct 19 13:56:47.034249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1568/3061] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:56:46 2022] DELETE /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:56:47.039197 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:56:47.039803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] [instance: 3f85d415-a454-4bd8-8230-f10c25bd5a40] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:56:47.046575 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:47.046981 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:47.047410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:47.048085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:56:47.048529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:56:47.048974 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:56:47.063143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] HTTP exception thrown: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Request method failure captured: Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 HTTP/1.1 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAEcAuMAOU8qlM3AUlpxKoEZazUSqMjj5RxIi2trtVyxyt5UFu27NXh42Qdv_8qzf9Qavy29yj_QCH7yjpr8ZDbXyxV1rbd_B9OmWW4F9NU5rwnF0vNpeV57XctYZCKFtA3-i6AKQstABPPtBvFNAHqolVGWuzwh7VmSYS-CrlK60LA Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:56:47.064659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0745acac5aad45fc8355a03bf8abc8c7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0745acac5aad45fc8355a03bf8abc8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0745acac5aad45fc8355a03bf8abc8c7 Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-703161516 Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 43d5beeaa1204d22b3ad9ffab6a69417 Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeNegativeTest-703161516-project Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.066080 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '3f85d415-a454-4bd8-8230-f10c25bd5a40'} Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:56:47.066747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. Oct 19 13:56:47.067801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:56:47.068739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] Returning 404 to user: Instance 3f85d415-a454-4bd8-8230-f10c25bd5a40 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:56:47.068739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1080498-6b43-4a1b-b93e-56502e9d864e tempest-AttachVolumeNegativeTest-703161516 tempest-AttachVolumeNegativeTest-703161516-project] 10.222.0.17 "GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40" status: 404 len: 111 microversion: 2.1 time: 0.030724 Oct 19 13:56:47.068739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1494/3062] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:56:47 2022] GET /compute/v2.1/servers/3f85d415-a454-4bd8-8230-f10c25bd5a40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:57:09.454491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1649389646", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "networks": [{"uuid": "042e1947-fa6f-4a53-aa10-fafffd546301"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:09.468382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=20 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:09.469075 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:09.469930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:57:09.470113 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 13:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 19 13:57:09.523002 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] validate_networks() for [('042e1947-fa6f-4a53-aa10-fafffd546301', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:57:09.928112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:57:09.928769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:57:09.929497 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:57:09.930099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:57:09.930703 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:57:09.940383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:09.940893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:09.941326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:09.942051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:09.942502 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:09.942926 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:09.960382 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Getting quotas for project 794af65ca9664b68baa42e0f67031abb. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:57:09.965534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Getting quotas for user 54fb0a6701d54438b4f296c3219bd25d and project 794af65ca9664b68baa42e0f67031abb. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:57:09.979575 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:57:09.983605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:57:10.038223 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ec546803-1e88-46f8-971d-f6b0533503c7 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589916 Oct 19 13:57:10.039000 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1569/3063] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:57:10.050175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-cf6dd94c-66fd-4058-9642-fdb5f5518ef1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:10.050784 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-cf6dd94c-66fd-4058-9642-fdb5f5518ef1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:10.053484 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:10.054140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:10.115789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-cf6dd94c-66fd-4058-9642-fdb5f5518ef1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:10.123008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-cf6dd94c-66fd-4058-9642-fdb5f5518ef1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1214 microversion: 2.1 time: 0.076729 Oct 19 13:57:10.123583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1495/3064] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:10 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:11.146466 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:11.147192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:11.153684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:11.154174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:11.154608 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:11.155311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:11.155762 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:11.156184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:11.226572 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:11.234748 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-45875ead-9d54-4de5-af1e-5bb19e3af7ec tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1284 microversion: 2.1 time: 0.092779 Oct 19 13:57:11.235490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1570/3065] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:11 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:12.258261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:12.258836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:12.266856 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:12.267348 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:12.267778 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:12.268467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:12.268915 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:12.269364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:12.465504 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:12.473601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-69850862-118e-48ab-aaf1-0ccb38cf7d5f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.219353 Oct 19 13:57:12.474181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1496/3066] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:12 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:12.544238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81322a88-1d81-4197-a793-e502c41879ef", "tag": "9d880074-784b-4a27-9074-76aff250852a"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:12.556153 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:12.556631 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:12.557258 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:12.568716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] Creating event network-changed:9d880074-784b-4a27-9074-76aff250852a for instance 81322a88-1d81-4197-a793-e502c41879ef on hv-cinder-maste Oct 19 13:57:12.574226 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-e378bf16-5fb6-4ecd-8746-5677524249f2 req-eeae3f36-b9a8-445a-8e4c-28e47e62ecca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033785 Oct 19 13:57:12.574919 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1571/3067] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:13.499635 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:13.500399 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:13.508838 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:13.509469 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:13.510008 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:13.510888 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:13.511996 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:13.512559 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:13.653565 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:13.661836 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dd6ce425-9769-43cf-9754-8f595c6918ad tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.168643 Oct 19 13:57:13.662400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1497/3068] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:13 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:14.690326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:14.691486 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:14.701142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:14.701630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:14.702069 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:14.702761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:14.703216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:14.703643 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:14.841521 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:14.849754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-5d9c5f0b-1236-4809-b142-e42b9d8dc04d tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.167373 Oct 19 13:57:14.850324 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1572/3069] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:14 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:15.878163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:15.879029 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:15.890066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:15.890844 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:15.891548 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:15.892708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:15.893486 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:15.894171 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:16.038625 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:16.051115 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8e3a5438-222c-4068-a9ea-1451d81b50ca tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.179860 Oct 19 13:57:16.052046 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1498/3070] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:15 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:17.073892 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:17.074482 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:17.081360 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:17.081855 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:17.082303 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:17.083147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:17.083611 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:17.084039 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:17.190470 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81322a88-1d81-4197-a793-e502c41879ef", "name": "network-vif-plugged", "status": "completed", "tag": "9d880074-784b-4a27-9074-76aff250852a"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:17.204107 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:17.204591 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:17.205217 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:17.219943 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] Creating event network-vif-plugged:9d880074-784b-4a27-9074-76aff250852a for instance 81322a88-1d81-4197-a793-e502c41879ef on hv-cinder-maste Oct 19 13:57:17.226572 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-b90649d1-62b4-4eeb-a5af-e507be650db8 req-6f74d06b-b768-43ac-ade8-9bea09b720fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044540 Oct 19 13:57:17.228432 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1499/3071] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:17.239651 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:17.254343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-8ea361af-18ae-48b9-a9f5-7cccc461b802 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.183431 Oct 19 13:57:17.264895 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1573/3072] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:17 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:18.282207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:18.282910 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:18.290063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:18.290517 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:18.291159 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:18.291851 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:18.292285 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:18.292715 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:18.425435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:18.433673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-2fdda532-b200-48c3-b3b9-eceb74fcf18a tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1314 microversion: 2.1 time: 0.156199 Oct 19 13:57:18.434256 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1500/3073] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:18 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:19.460609 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:19.461799 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:19.470984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:19.471472 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:19.471901 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:19.472615 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:19.473106 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:19.473526 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:19.618344 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:19.626471 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-eddb82ef-1fa0-4ed0-b632-fb5bbcb93be6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1498 microversion: 2.1 time: 0.172337 Oct 19 13:57:19.627078 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1574/3074] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:19 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:20.039324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:20.039893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:20.046747 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:20.047228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:20.047657 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:20.048344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:20.048800 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:20.049255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:20.081536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Going to try to terminate instance {{(pid=118982) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:57:20.120148 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:20.165209 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-961b67a8-7b1a-4a2c-95fa-d0b6da05faf3 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 204 len: 0 microversion: 2.1 time: 0.129348 Oct 19 13:57:20.165759 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1501/3075] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:57:20 2022] DELETE /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:57:20.174108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:20.174711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:20.176677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:20.177368 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:20.182705 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:20.183178 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:20.183605 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:20.184279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:20.184844 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:20.185320 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:20.314218 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:20.322211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a494f108-8043-4f88-939b-ee9996ad2b9e tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1504 microversion: 2.1 time: 0.151955 Oct 19 13:57:20.322776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1575/3076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:20 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:21.346263 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:21.346955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:21.353884 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:21.354356 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:21.354775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:21.355451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:21.355891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:21.356303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:21.504419 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:21.519864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a26bf779-6d7e-4bc8-acc0-b43f40213e99 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 200 len: 1504 microversion: 2.1 time: 0.177806 Oct 19 13:57:21.535583 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1502/3077] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:21 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:21.970273 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81322a88-1d81-4197-a793-e502c41879ef", "name": "network-vif-deleted", "tag": "9d880074-784b-4a27-9074-76aff250852a"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:21.980287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:21.980778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:21.981249 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:21.992987 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] Creating event network-vif-deleted:9d880074-784b-4a27-9074-76aff250852a for instance 81322a88-1d81-4197-a793-e502c41879ef on hv-cinder-maste Oct 19 13:57:21.998330 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-a3b83337-78bf-400d-9fb3-9fde4f24356f req-e51ef77f-c3dd-4243-9f51-bba3b2094fb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031969 Oct 19 13:57:21.999180 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1576/3078] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:22.542616 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:22.543390 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 81322a88-1d81-4197-a793-e502c41879ef] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:22.550064 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:22.550627 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:22.551126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:22.551845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:22.552384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:22.552938 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:22.567163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] HTTP exception thrown: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Request method failure captured: Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef HTTP/1.1 Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAIzsYsXS3kqTdYfgewOtRYSxbP_21MT1s9bAof5A0RSjs5WJOM1uuJ2Df-YXSfNM_A2ZBfy36T1hubtOcMS9XFfy7Pah7jTl0Zc2TX7mLHR4H0opcxfnjQbtZSEowZF28GyF8wWLkG6aYgDc_uoCThuw7jUJ5qVL0L4u5W8B5QuEWY Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 794af65ca9664b68baa42e0f67031abb Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-VolumesActionsTest-54722191 Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:57:22.568983 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_794af65ca9664b68baa42e0f67031abb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-VolumesActionsTest-54722191 Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 794af65ca9664b68baa42e0f67031abb Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-VolumesActionsTest-54722191 Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-VolumesActionsTest-54722191-project Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 54fb0a6701d54438b4f296c3219bd25d Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-VolumesActionsTest-54722191-project Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. Oct 19 13:57:22.570392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '81322a88-1d81-4197-a793-e502c41879ef'} Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:57:22.571414 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. Oct 19 13:57:22.572727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:57:22.575977 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Returning 404 to user: Instance 81322a88-1d81-4197-a793-e502c41879ef could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:57:22.576951 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b0b577de-bb72-40c7-82d9-d11a7f029a30 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef" status: 404 len: 111 microversion: 2.1 time: 0.038242 Oct 19 13:57:22.577534 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1503/3079] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:22 2022] GET /compute/v2.1/servers/81322a88-1d81-4197-a793-e502c41879ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:57:22.628562 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1801544415", "imageRef": "de7235cd-7594-4553-8aed-43b564a4c304", "flavorRef": "452", "networks": [{"uuid": "042e1947-fa6f-4a53-aa10-fafffd546301"}]}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:22.683772 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.network.neutron [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] validate_networks() for [('042e1947-fa6f-4a53-aa10-fafffd546301', None, None, None, None, None)] {{(pid=118983) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:57:23.045476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Flavor limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:57:23.046083 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Image limits 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:57:23.046361 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Flavor pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:57:23.046775 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Image pref 0:0:0 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:57:23.047216 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.virt.hardware [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:57:23.056782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:23.057306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:23.057712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:23.058441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:23.058888 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:23.059311 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:23.077190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Getting quotas for project 794af65ca9664b68baa42e0f67031abb. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:57:23.081293 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Getting quotas for user 54fb0a6701d54438b4f296c3219bd25d and project 794af65ca9664b68baa42e0f67031abb. Resources: {'ram', 'instances', 'cores'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:57:23.093584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Going to run 1 instances... {{(pid=118983) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:57:23.096006 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='de7235cd-7594-4553-8aed-43b564a4c304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:57:23.150618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d424902a-1073-46a9-8c63-fb748ba23ed6 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526345 Oct 19 13:57:23.151278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1577/3080] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:57:23.163258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-86b456f5-5458-4a0f-9cf1-eb9db0919014 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:23.163963 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-86b456f5-5458-4a0f-9cf1-eb9db0919014 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:23.220802 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-86b456f5-5458-4a0f-9cf1-eb9db0919014 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:23.227699 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-86b456f5-5458-4a0f-9cf1-eb9db0919014 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1214 microversion: 2.1 time: 0.068552 Oct 19 13:57:23.228255 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1504/3081] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:23 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:24.252973 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:24.254334 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:24.265530 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:24.266156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:24.266607 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:24.267571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:24.267980 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:24.268742 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:24.351219 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:24.360034 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ebef489b-1789-4482-a9e4-940b289836bc tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1272 microversion: 2.1 time: 0.112170 Oct 19 13:57:24.360650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1578/3082] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:24 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:25.383792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:25.384556 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:25.394249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:25.395173 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:25.395765 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:25.396643 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:25.397288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:25.397870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:25.638420 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:25.646880 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d159e39b-64eb-4415-97c1-c42adfd55f67 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.266941 Oct 19 13:57:25.647453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1505/3083] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:25 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:25.846142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ff3a07-59ee-40d7-8ece-0cc877806503", "tag": "59641d82-31f5-4f08-9856-9f8309969137"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:25.858284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:25.858729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:25.859155 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:25.871957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] Creating event network-changed:59641d82-31f5-4f08-9856-9f8309969137 for instance 71ff3a07-59ee-40d7-8ece-0cc877806503 on hv-cinder-maste Oct 19 13:57:25.876957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-a79632b1-80f0-486c-a178-e688e844b427 req-17a2e8bf-843d-4452-aa1c-9b8058969ca6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 Oct 19 13:57:25.878103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1579/3084] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:26.673864 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:26.674633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:26.683899 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:26.684540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:26.685221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:26.686530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:26.687136 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:26.687702 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:26.833229 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:26.841427 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-89348967-8a7a-4e84-a258-353c9ed97c1f tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.173853 Oct 19 13:57:26.842020 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1506/3085] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:26 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:27.864726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:27.865475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:27.872332 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:27.872899 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:27.873509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:27.874183 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:27.874635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:27.875049 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:28.006312 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:28.016168 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d1314d0-8f45-49fb-928e-8c0fd78906f8 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.155571 Oct 19 13:57:28.016759 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1580/3086] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:27 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:29.039157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:29.039749 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:29.046585 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:29.047063 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:29.047485 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:29.048167 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:29.048763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:29.049223 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:29.179040 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:29.188095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c9431068-cc46-4d70-b54d-5aa2670be9d1 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.152840 Oct 19 13:57:29.189207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1507/3087] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:29 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:30.212217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:30.212930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:30.221500 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:30.221914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:30.222346 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:30.223030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:30.223478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:30.223890 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:30.360176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:30.368504 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-64a845fe-08c7-49ec-bb92-60c766d1de55 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.160898 Oct 19 13:57:30.369095 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1581/3088] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:30 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:31.134500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ff3a07-59ee-40d7-8ece-0cc877806503", "name": "network-vif-plugged", "status": "completed", "tag": "59641d82-31f5-4f08-9856-9f8309969137"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:31.145961 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:31.146409 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:31.146834 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:31.159092 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] Creating event network-vif-plugged:59641d82-31f5-4f08-9856-9f8309969137 for instance 71ff3a07-59ee-40d7-8ece-0cc877806503 on hv-cinder-maste Oct 19 13:57:31.164288 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-243dceac-de83-47b0-b5d9-ea52451598cc req-6534f4e7-58bc-4ef3-b1e0-6c57d286acc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Oct 19 13:57:31.164895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1508/3089] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:31.391670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:31.392304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:31.399339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:31.399816 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:31.400245 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:31.400965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:31.401414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:31.401829 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:31.536716 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:31.548200 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-62a7d920-295b-4c87-94ee-cf63fee30720 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1314 microversion: 2.1 time: 0.160501 Oct 19 13:57:31.548957 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1582/3090] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:31 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:32.577474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:32.578684 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:32.585796 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:32.586269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:32.586695 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:32.587374 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:32.587815 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:32.588237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:32.731917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:32.740163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-974bf96a-33eb-48b1-8b0f-d7d4793736cd tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1498 microversion: 2.1 time: 0.170547 Oct 19 13:57:32.740721 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1509/3091] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:32 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:33.227522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:33.228094 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:33.230579 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:33.231286 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=6 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:33.237240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:33.237729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:33.238176 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:33.238872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:33.239327 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:33.239754 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:33.265120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 13:57:33.350632 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-75d00da8-2eed-446a-8fd5-7f044ed1330c tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 204 len: 0 microversion: 2.1 time: 0.126629 Oct 19 13:57:33.351436 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1583/3092] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 13:57:33 2022] DELETE /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 13:57:33.359492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:33.360128 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:33.362224 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:57:33.367609 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:33.368079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:33.368503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:33.369207 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:33.369646 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:33.370060 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:33.500346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:33.512219 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c76db088-2e64-4292-a819-0d04bd7e4b24 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1504 microversion: 2.1 time: 0.156338 Oct 19 13:57:33.513007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1510/3093] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:33 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:34.540236 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:34.541433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:34.552354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:34.553198 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:34.553952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:34.555084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:34.555834 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:34.556542 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:34.695569 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fb0a6701d54438b4f296c3219bd25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794af65ca9664b68baa42e0f67031abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:57:34.703535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-6b9d2a8b-ee92-40d4-b611-675f0fdb3260 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 200 len: 1504 microversion: 2.1 time: 0.170426 Oct 19 13:57:34.704109 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1584/3094] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:34 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:57:35.101590 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ff3a07-59ee-40d7-8ece-0cc877806503", "name": "network-vif-deleted", "tag": "59641d82-31f5-4f08-9856-9f8309969137"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:57:35.112909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:35.113481 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:35.114181 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:35.126510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] Creating event network-vif-deleted:59641d82-31f5-4f08-9856-9f8309969137 for instance 71ff3a07-59ee-40d7-8ece-0cc877806503 on hv-cinder-maste Oct 19 13:57:35.131393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-a1dea14c-b6b1-4370-8ec3-a225383bd088 req-6ff49370-c472-467a-91e9-e5a76e227050 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Oct 19 13:57:35.132084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1511/3095] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:57:35.731246 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:57:35.732474 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] [instance: 71ff3a07-59ee-40d7-8ece-0cc877806503] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:57:35.741165 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:35.741653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:35.742074 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:35.742790 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:57:35.743274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:57:35.743694 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:57:35.757662 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] HTTP exception thrown: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Request method failure captured: Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 HTTP/1.1 Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjUAIzsYsXS3kqTdYfgewOtRYSxbP_21MT1s9bAof5A0RSjs5WJOM1uuJ2Df-YXSfNM_A2ZBfy36T1hubtOcMS9XFfy7Pah7jTl0Zc2TX7mLHR4H0opcxfnjQbtZSEowZF28GyF8wWLkG6aYgDc_uoCThuw7jUJ5qVL0L4u5W8B5QuEWY Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 794af65ca9664b68baa42e0f67031abb Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-VolumesActionsTest-54722191 Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:57:35.759306 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_794af65ca9664b68baa42e0f67031abb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/794af65ca9664b68baa42e0f67031abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-VolumesActionsTest-54722191 Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 794af65ca9664b68baa42e0f67031abb Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-VolumesActionsTest-54722191 Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-VolumesActionsTest-54722191-project Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 54fb0a6701d54438b4f296c3219bd25d Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-VolumesActionsTest-54722191-project Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. Oct 19 13:57:35.760821 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '71ff3a07-59ee-40d7-8ece-0cc877806503'} Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:57:35.761658 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. Oct 19 13:57:35.762849 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:57:35.763851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] Returning 404 to user: Instance 71ff3a07-59ee-40d7-8ece-0cc877806503 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:57:35.763851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-50a09da9-b737-4ed0-a90f-fdcd369ff836 tempest-VolumesActionsTest-54722191 tempest-VolumesActionsTest-54722191-project] 10.222.0.17 "GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503" status: 404 len: 111 microversion: 2.1 time: 0.036082 Oct 19 13:57:35.763851 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1585/3096] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:57:35 2022] GET /compute/v2.1/servers/71ff3a07-59ee-40d7-8ece-0cc877806503 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:58:20.205714 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.206580 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.210922 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:20.211503 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:20.222893 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.223586 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.224210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.225257 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.225887 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.226467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.242632 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] HTTP exception thrown: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Request method failure captured: Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 HTTP/1.1 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjT_gzO5MD7vOdQBW2spKKLnta8r4RLviGDeJgaE_gWoklIRtDgQbxnMAmvcY_ulW2FZC29cWoczq6VjpCAUBj-WFVKD8lb_srb6JB8Wm5w8sbCGoXSfRGHQo2_whpgejYyoBQBhU4eu_5MgiXOZAvfwhr1zQBFIZhw8MGc8irvenWGsA Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:58:20.244305 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a5888bfc20042a791f6798975b860fd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 7e6d95493f8e4b58a9a212999916e6b1 Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.245831 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '26717ab1-6c97-4d22-afe6-d00760711621'} Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:58:20.246569 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.247686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.248792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Returning 404 to user: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:58:20.248792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3aee1624-91c6-483d-a438-802c30fbf923 tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 404 len: 111 microversion: 2.20 time: 0.041743 Oct 19 13:58:20.248792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1512/3097] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Oct 19 13:58:20 2022] DELETE /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:58:20.254715 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:20.255278 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] [instance: 26717ab1-6c97-4d22-afe6-d00760711621] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:58:20.257633 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.258276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:20.265251 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.265740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.266187 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.266868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:58:20.267300 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:58:20.267914 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:58:20.286166 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.wsgi [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] HTTP exception thrown: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Request method failure captured: Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: request: GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 HTTP/1.1 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept: application/json Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Accept-Encoding: identity Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Connection: close Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Length: 0 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Content-Type: application/json Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Host: 10.222.0.17 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Openstack-System-Scope: None Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: User-Agent: python-urllib3/1.26.12 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Auth-Token: gAAAAABjT_gzO5MD7vOdQBW2spKKLnta8r4RLviGDeJgaE_gWoklIRtDgQbxnMAmvcY_ulW2FZC29cWoczq6VjpCAUBj-WFVKD8lb_srb6JB8Wm5w8sbCGoXSfRGHQo2_whpgejYyoBQBhU4eu_5MgiXOZAvfwhr1zQBFIZhw8MGc8irvenWGsA Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Id: None Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Domain-Name: None Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Identity-Status: Confirmed Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Is-Admin-Project: True Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Id: default Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Domain-Name: Default Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Role: reader,member Oct 19 13:58:20.287761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Roles: reader,member Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a5888bfc20042a791f6798975b860fd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a5888bfc20042a791f6798975b860fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Id: 0a5888bfc20042a791f6798975b860fd Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639438610 Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Id: default Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Domain-Name: Default Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Id: 7e6d95493f8e4b58a9a212999916e6b1 Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639438610-project Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: method: > Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: exception: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.289030 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: action_args: {'id': '26717ab1-6c97-4d22-afe6-d00760711621'} Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:58:20.289699 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. Oct 19 13:58:20.290765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR nova.api.openstack.wsgi Oct 19 13:58:20.291739 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] Returning 404 to user: Instance 26717ab1-6c97-4d22-afe6-d00760711621 could not be found. {{(pid=118983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:58:20.292824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-a884ba68-d679-4a7b-a22a-78b463ac3b0d tempest-AttachVolumeShelveTestJSON-1639438610 tempest-AttachVolumeShelveTestJSON-1639438610-project] 10.222.0.17 "GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621" status: 404 len: 111 microversion: 2.20 time: 0.038696 Oct 19 13:58:20.293527 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1586/3098] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Oct 19 13:58:20 2022] GET /compute/v2.1/servers/26717ab1-6c97-4d22-afe6-d00760711621 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 13:58:24.892933 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d276146a-9d6e-4385-aa76-c79be721fce6 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Action: 'create', calling method: .version_select at 0x7ff4fc9abe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1674542699", "metadata": {"Type": "work"}}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:25.202473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d276146a-9d6e-4385-aa76-c79be721fce6 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.434900 Oct 19 13:58:25.203312 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1513/3099] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Oct 19 13:58:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 13:58:25.216788 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-61b40e71-97e2-4039-99d6-edaa4085863e tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4f9288790>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:25.269571 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-61b40e71-97e2-4039-99d6-edaa4085863e tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 200 len: 353 microversion: 2.1 time: 0.057184 Oct 19 13:58:25.270149 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1587/3100] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:58:25 2022] GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:26.284189 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a5d5fc71-998e-4536-b4a9-567d52664e33 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4f907c0d0>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:26.334344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a5d5fc71-998e-4536-b4a9-567d52664e33 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 200 len: 354 microversion: 2.1 time: 0.054522 Oct 19 13:58:26.334917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1514/3101] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:58:26 2022] GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:26.348852 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-69bd77f9-4269-4977-8359-457161892a85 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4fca435e0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:26.397670 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-69bd77f9-4269-4977-8359-457161892a85 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 200 len: 354 microversion: 2.1 time: 0.053119 Oct 19 13:58:26.398260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1588/3102] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:58:26 2022] GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:26.417155 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-7998f016-b724-42e8-a135-87e25e39bc1c tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4fc9abf70>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:26.484739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-7998f016-b724-42e8-a135-87e25e39bc1c tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 202 len: 0 microversion: 2.1 time: 0.071442 Oct 19 13:58:26.485338 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1515/3103] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Oct 19 13:58:26 2022] DELETE /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 13:58:26.493491 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d290739e-c716-4ea1-a2c1-2e44e603002e tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4f91b30d0>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:26.541016 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d290739e-c716-4ea1-a2c1-2e44e603002e tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 200 len: 353 microversion: 2.1 time: 0.051373 Oct 19 13:58:26.541582 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1589/3104] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:58:26 2022] GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:58:27.556007 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d4bafe0-5436-4d3b-8878-c0a0e5cb6dc7 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Calling method '.version_select at 0x7ff4f9fb9b80>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:58:27.585393 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-5d4bafe0-5436-4d3b-8878-c0a0e5cb6dc7 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] HTTP exception thrown: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d4bafe0-5436-4d3b-8878-c0a0e5cb6dc7 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Request method failure captured: Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 HTTP/1.1 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAKA5oCkIh2cgLkV6oa6GZvEjlzWkvWZz6NVoHJW4OxtRwd-CUpHmqfp2w2OuTwnMTZzDzj2xoRt2E8CVsCJt0XuEFYAcxQngWbpOrSJJuEA2RzSk2EdTV9d2RYm0eZpvLLx76z8XJA6s16VYNMWlMBGoC0Z_BXLpGfG-ZkiyP_cp7E Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: 025bcd2f76ac4df79285cf645f101c09 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-VolumesGetTestJSON-1428309559 Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 13:58:27.588028 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_025bcd2f76ac4df79285cf645f101c09", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/025bcd2f76ac4df79285cf645f101c09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/025bcd2f76ac4df79285cf645f101c09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/025bcd2f76ac4df79285cf645f101c09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-VolumesGetTestJSON-1428309559 Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: 025bcd2f76ac4df79285cf645f101c09 Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-VolumesGetTestJSON-1428309559 Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-VolumesGetTestJSON-1428309559-project Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: 7b01a01017ca45bd90b4835181094d12 Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-VolumesGetTestJSON-1428309559-project Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '13f9bb12-075c-4415-a01d-ab32615e8a99'} Oct 19 13:58:27.589515 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. (HTTP 404) (Request-ID: req-6262f55b-191b-4215-86af-66337583f264) Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:27.590581 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 13:58:27.591821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 13:58:27.593134 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5d4bafe0-5436-4d3b-8878-c0a0e5cb6dc7 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] Returning 404 to user: Volume 13f9bb12-075c-4415-a01d-ab32615e8a99 could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5d4bafe0-5436-4d3b-8878-c0a0e5cb6dc7 tempest-VolumesGetTestJSON-1428309559 tempest-VolumesGetTestJSON-1428309559-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99" status: 404 len: 109 microversion: 2.1 time: 0.037894 Oct 19 13:58:27.594265 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1516/3105] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Oct 19 13:58:27 2022] GET /compute/v2.1/os-volumes/13f9bb12-075c-4415-a01d-ab32615e8a99 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 13:58:42.707679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:42.708528 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:58:42.993443 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Action: 'create', calling method: .version_select at 0x7ff4f93443a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-952342483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH1iDg1Mz3OD4nYNomknWsSkWMLgrizQhV2LUsL3GCwn5x55L43NOnHSkbs4EYiST+5IelN6xqMX2MVm1yTu+eEN2uBbMbHSV5Wv11gtA2Y7ibTsIXi/61rf5IBsQVAaw=="}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:58:43.014084 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Getting quotas for project c6650694dfd04f6eb1e32c5bf16e7e71. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:58:43.019665 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.quota [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Getting quotas for user d9f75c86d3da4dc1ba3da370f94d7885 and project c6650694dfd04f6eb1e32c5bf16e7e71. Resources: {'key_pairs'} {{(pid=118983) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:58:43.035688 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [3da70507-ea55-4498-a575-882e3d606eb7] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 13:58:44.046017 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [3da70507-ea55-4498-a575-882e3d606eb7] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39114. Oct 19 13:58:44.062877 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-30e60038-75b6-44a9-9491-e8a858913daf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.357611 Oct 19 13:58:44.063995 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1590/3106] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Oct 19 13:58:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:05.963052 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:05.964462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:05.966578 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 13:59:05.966805 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 13:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Oct 19 13:59:05.973438 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1759031163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-952342483", "security_groups": [{"name": "tempest-secgroup-smoke-1497222748"}], "networks": [{"uuid": "6d2db52e-64f5-4350-b5ed-89e28d97d017"}], "block_device_mapping_v2": [{"uuid": "85f92da2-1530-49bb-a64c-691db89d335d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:06.105997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.network.neutron [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] validate_networks() for [('6d2db52e-64f5-4350-b5ed-89e28d97d017', None, None, None, None, None)] {{(pid=118982) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 13:59:06.577053 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Flavor limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 13:59:06.577659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Image limits 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 13:59:06.578303 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Flavor pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 13:59:06.578804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Image pref 0:0:0 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 13:59:06.579436 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.virt.hardware [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118982) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 13:59:06.591990 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:06.592535 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:06.593015 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:06.593743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:06.594184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:06.594599 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:06.611982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Getting quotas for project c6650694dfd04f6eb1e32c5bf16e7e71. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 13:59:06.616017 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.quota [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Getting quotas for user d9f75c86d3da4dc1ba3da370f94d7885 and project c6650694dfd04f6eb1e32c5bf16e7e71. Resources: {'ram', 'instances', 'cores'} {{(pid=118982) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 13:59:06.680391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Going to run 1 instances... {{(pid=118982) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 13:59:06.682803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85f92da2-1530-49bb-a64c-691db89d335d',volume_size=None,volume_type=None)] {{(pid=118982) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 13:59:06.819221 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-5099565f-9cd9-45b8-a890-9a98882dffe2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.858326 Oct 19 13:59:06.819859 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1517/3107] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Oct 19 13:59:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 13:59:06.831279 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ff9b2a61-f436-49b4-b03d-9fb3229246d8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:06.831893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ff9b2a61-f436-49b4-b03d-9fb3229246d8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:06.835807 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=4 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:06.836453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:06.893737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ff9b2a61-f436-49b4-b03d-9fb3229246d8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:06.901072 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ff9b2a61-f436-49b4-b03d-9fb3229246d8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1088 microversion: 2.1 time: 0.073736 Oct 19 13:59:06.901640 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1591/3108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:06 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:07.928000 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:07.929154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:07.936975 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:07.937453 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:07.937885 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:07.938570 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:07.939019 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:07.939468 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:08.012362 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:08.024708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b76b5318-de2a-4d6e-b341-5597c8a022bf tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1138 microversion: 2.1 time: 0.103931 Oct 19 13:59:08.025502 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1518/3109] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:07 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1138 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:09.048210 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:09.048947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:09.056164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:09.056649 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:09.057192 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:09.058056 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:09.058531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:09.058945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:09.121587 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:09.129690 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-7fe1203a-856e-42f5-a303-10693cb7f29e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1138 microversion: 2.1 time: 0.085342 Oct 19 13:59:09.130227 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1592/3110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:09 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:10.159794 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:10.162012 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:10.169680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:10.170739 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:10.171435 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:10.175154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:10.176373 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:10.177192 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:10.262536 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:10.270971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1c861b83-8557-4d16-a96e-00ff27678fdb tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1204 microversion: 2.1 time: 0.123025 Oct 19 13:59:10.271860 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1519/3111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:10 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1204 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:11.066453 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:11.077425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:11.077988 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:11.078494 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:11.091420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] Creating event network-changed:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 13:59:11.096693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-c24c3d55-77aa-4773-8425-7f642728bdea req-a175e245-4c5f-4911-8776-2ccc5a7344cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Oct 19 13:59:11.097456 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1593/3112] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:11.296648 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:11.297328 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:11.304673 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:11.305184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:11.305620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:11.306311 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:11.306758 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:11.307193 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:11.511587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:11.519782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-da6c97ca-a1e0-4787-a1b4-1a1caab2c94b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.228450 Oct 19 13:59:11.520651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1520/3113] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:11 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:12.548477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:12.549664 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:12.559733 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:12.560120 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:12.560548 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:12.561297 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:12.561746 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:12.562169 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:12.714342 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:12.722432 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-b77a64a9-0c7b-44b6-9b83-4c1e86fae871 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.181978 Oct 19 13:59:12.723001 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1594/3114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:12 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:13.750101 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:13.751089 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:13.761801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:13.762241 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:13.762662 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:13.763336 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:13.763775 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:13.764184 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:13.907911 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:13.915861 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f9afa2b1-55a6-429b-aadd-5add1ffee033 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.172601 Oct 19 13:59:13.916417 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1521/3115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:13 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:14.938305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:14.938934 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:14.945490 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:14.946015 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:14.946449 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:14.947108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:14.947559 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:14.947976 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:15.088354 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:15.097230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-962ff830-1c99-4668-b7e9-8a79fa77cfca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.162690 Oct 19 13:59:15.097828 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1595/3116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:14 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:16.119936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:16.120546 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:16.127926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:16.128422 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:16.128892 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:16.129636 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:16.130079 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:16.130500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:16.268801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:16.276891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-d8a9a362-69b2-42fb-8719-aab33acf23f3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.161131 Oct 19 13:59:16.277500 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1522/3117] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:16 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:17.300641 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:17.301287 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:17.303358 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell0:SELECT=2 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:17.308727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:17.309425 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:17.310217 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:17.311123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:17.311830 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:17.312447 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:17.446847 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:17.455259 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4406d043-bcf7-4081-8e66-11bf228a5e0c tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.158987 Oct 19 13:59:17.455809 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1596/3118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:17 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:18.482494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:18.483633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:18.487033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=2 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:18.488296 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell0:SELECT=6 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 13:59:18.498816 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:18.499743 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:18.500190 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:18.500895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:18.501346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:18.501761 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:18.644237 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:18.656918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-62a2ffc0-db09-4f3a-b351-df37cac82d6f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.180624 Oct 19 13:59:18.657692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1523/3119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:18 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:19.680005 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:19.680610 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:19.687872 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:19.688352 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:19.688778 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:19.689503 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:19.689945 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:19.690362 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:19.831584 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:19.844366 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d2d7dcb-73cc-45bd-bbe8-091916cfd6fd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.168361 Oct 19 13:59:19.844930 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1597/3120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:19 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:20.871400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:20.872651 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:20.883870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:20.884512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:20.885287 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:20.886424 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:20.887168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:20.887886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:21.026324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:21.034384 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-00fadf80-8dd4-4f04-a126-605271c19885 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.169540 Oct 19 13:59:21.034978 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1524/3121] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:20 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:22.061335 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:22.062343 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:22.069956 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:22.070430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:22.070859 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:22.071545 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:22.071991 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:22.072407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:22.217417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:22.226462 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9cca2ca3-0a50-41ab-a257-2ba9a489180d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.171642 Oct 19 13:59:22.227038 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1598/3122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:22 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:23.253719 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:23.254594 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:23.265601 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:23.266388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:23.267090 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:23.268208 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:23.268927 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:23.269669 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:23.404602 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:23.414511 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-3d19779e-3edc-429d-b47a-4bea0901f3db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.167569 Oct 19 13:59:23.415043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1525/3123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:23 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:23.691867 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "name": "network-vif-plugged", "status": "completed", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:23.702520 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:23.703553 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:23.703812 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:23.716959 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] Creating event network-vif-plugged:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 13:59:23.722164 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-afa4f6db-9dc3-4744-a1c2-703df5f0f358 req-e77ee934-4d29-4026-877e-0d53f227a043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Oct 19 13:59:23.722711 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1599/3124] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 13:59:24.441144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:24.442175 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:24.450344 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:24.450875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:24.451392 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:24.452126 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:24.452641 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:24.453095 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:24.591529 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:24.599659 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-c1c46da8-c8cd-41bf-b1f0-333fd08ead7b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.164943 Oct 19 13:59:24.600231 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1526/3125] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:24 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:25.623950 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:25.624639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:25.631133 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:25.631595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:25.632478 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:25.633205 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:25.633685 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:25.634114 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:25.767117 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:25.778585 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c0e58f5d-7eb1-42b9-9057-2c7ee5369b57 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1260 microversion: 2.1 time: 0.159444 Oct 19 13:59:25.779145 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1600/3126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:25 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:26.804986 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:26.805912 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:26.813232 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:26.813712 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:26.814138 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:26.814875 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:26.815321 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:26.815736 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:26.954679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:26.962738 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-a441439f-9e8c-491f-865c-ad7d27c778d9 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1445 microversion: 2.1 time: 0.163975 Oct 19 13:59:26.963334 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1527/3127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:26 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:26.985085 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 13:59:26.985677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 13:59:26.992211 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:26.992672 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:26.993123 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:26.993815 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:26.994264 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:26.994684 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:27.129400 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 13:59:27.137970 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-2aa81fb6-e213-41cc-bd07-0092bcce2200 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1445 microversion: 2.1 time: 0.156802 Oct 19 13:59:27.138537 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1601/3128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 13:59:26 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 13:59:29.174410 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 13:59:29.184563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 13:59:29.185066 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 13:59:29.185492 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 13:59:29.197277 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] Creating event network-changed:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 13:59:29.202783 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-d937ff6b-1f99-413f-8b65-b86c6f975aa8 req-f00977f1-bb05-4466-ad7e-dbc2c893cd08 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Oct 19 13:59:29.203428 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1528/3129] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 13:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 14:01:24.474675 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=24 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:24.475450 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=52 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:24.477025 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 19 14:01:24.477897 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 14:01:24.478050 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: Wed Oct 19 14:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d/action (ip 10.222.0.17) !!! Oct 19 14:01:24.484158 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:01:24.484954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:24.494233 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:24.494712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:24.495151 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:24.495845 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:24.496301 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:24.496722 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:24.522268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lazy-loading 'flavor' on Instance uuid 172b351d-94a9-4234-8228-87730325dd7d {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 14:01:24.600522 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c5069fe3-769e-4416-bef9-ee44601dad41 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "POST /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d/action" status: 202 len: 0 microversion: 2.1 time: 0.128905 Oct 19 14:01:24.601104 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1602/3130] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 14:01:24 2022] POST /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 14:01:24.607770 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24f42617-d8d0-4ded-8970-29f16cb25b83] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 14:01:24.608366 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:24.609215 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=64 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:24.614512 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:24.615202 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:24.622748 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:24.623218 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:24.623654 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:24.624355 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:24.624791 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:24.625228 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:24.767144 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:24.775154 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-4d3c69ab-7511-45c3-a03c-792595df132f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.169246 Oct 19 14:01:24.775709 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1529/3131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:24 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:25.806041 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:25.807201 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:25.816444 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:25.816949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:25.817393 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:25.818080 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:25.818540 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:25.818965 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:26.148737 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:26.156644 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-36590a1c-36bf-405c-a80e-63383fd2a569 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.358450 Oct 19 14:01:26.157477 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1603/3132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:25 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:27.183955 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:27.185072 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:27.194205 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:27.194677 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:27.195100 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:27.195782 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:27.196222 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:27.196618 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:27.201889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] [24f42617-d8d0-4ded-8970-29f16cb25b83] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39736. Oct 19 14:01:27.588310 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:27.600400 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-dec462b7-52cc-418c-81ad-7e0581358b1d tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.422680 Oct 19 14:01:27.601238 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1530/3133] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:27 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:28.631650 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:28.632534 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:28.643595 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:28.644409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:28.645174 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:28.646305 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:28.647053 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:28.647776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:28.792099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:28.804920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c065d7b3-cf26-44a7-88c4-9f89c4b474ca tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.179767 Oct 19 14:01:28.805761 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1604/3134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:28 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:29.834247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:29.834997 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:29.841554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:29.842037 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:29.842474 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:29.843157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:29.843949 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:29.844365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:29.981234 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:29.989447 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-b374a2d7-9a86-4806-b2cf-d722287606c4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.160365 Oct 19 14:01:29.990018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1531/3135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:29 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:31.017356 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:31.018539 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:31.029441 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:31.030240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:31.030969 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:31.032102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:31.032949 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:31.033726 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:31.175044 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:31.182868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-3310fe19-a691-465e-a770-ce3656c3e4d5 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.172149 Oct 19 14:01:31.183437 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1605/3136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:31 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:32.208506 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:32.209249 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:32.217466 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:32.218062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:32.218959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:32.219809 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:32.220391 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:32.220917 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:32.368909 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:32.380680 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-6c7966fa-6d38-4be1-963d-3452b209f63f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.177799 Oct 19 14:01:32.381261 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1532/3137] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:32 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:33.417274 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:33.418422 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:33.427190 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:33.427679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:33.428108 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:33.428794 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:33.429276 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:33.429693 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:33.573507 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:33.581985 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-f1bc7dc5-59eb-457a-8f71-5e501322348a tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.171293 Oct 19 14:01:33.582546 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1606/3138] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:33 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:34.610212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:34.611117 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:34.622213 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:34.623013 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:34.623733 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:34.624925 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:34.625763 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:34.626462 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:34.766918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:34.779131 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-93cf135e-c874-4dd6-a9ff-c712eb28bd8e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.175259 Oct 19 14:01:34.779914 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1533/3139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:34 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:35.806240 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:35.806909 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:35.814627 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:35.815156 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:35.815636 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:35.816386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:35.817193 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:35.817347 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:35.953667 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:35.961509 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-ba544df9-0399-4dfc-8504-3e31cbb75ad4 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.159596 Oct 19 14:01:35.962051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1607/3140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:35 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:36.989056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:36.989926 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:37.000803 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:37.001690 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:37.002407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:37.003540 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:37.004600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:37.005554 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:37.146600 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:37.155787 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-81934c05-834e-4881-88c6-7bdf03b4480f tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.173259 Oct 19 14:01:37.156346 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1534/3141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:36 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:38.181414 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:38.182142 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:38.190824 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.191420 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.191986 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.192840 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.193435 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.193955 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.328475 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:38.337294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9ca9e2d9-33f5-4415-83f0-69a2bc2e0961 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1511 microversion: 2.1 time: 0.160822 Oct 19 14:01:38.337868 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1608/3142] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:38 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:38.359966 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:01:38.360521 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:38.368070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.368547 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.369009 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.369692 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.370139 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.370551 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.415018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118982) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 14:01:38.497365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-e87da758-64fb-4acd-9268-0abe63bc8b11 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "POST /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d/action" status: 202 len: 0 microversion: 2.1 time: 0.140775 Oct 19 14:01:38.497891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1535/3143] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Oct 19 14:01:38 2022] POST /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 14:01:38.506304 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:38.506917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:38.512813 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.513329 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.513769 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.514464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:38.514915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:38.515408 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:38.684814 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:38.697225 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-cae70e00-770b-4c12-8bd2-f858cf31e8bd tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1519 microversion: 2.1 time: 0.194497 Oct 19 14:01:38.698101 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1609/3144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:38 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:39.724086 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:39.724723 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:39.732043 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:39.732617 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:39.733163 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:39.733976 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:39.734413 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:39.734845 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:39.926620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:39.935889 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-375abe7e-bdae-4ced-a975-dd1bf156b5e3 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1519 microversion: 2.1 time: 0.215817 Oct 19 14:01:39.936473 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1536/3145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:39 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:40.960370 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:40.960952 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:40.967850 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:40.968341 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:40.969112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:40.969858 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:40.970284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:40.970700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:41.103915 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:41.111939 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-fde33007-c1ca-47ce-b81f-3d6c8f6cf668 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1519 microversion: 2.1 time: 0.155658 Oct 19 14:01:41.112747 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1610/3146] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:40 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:41.299170 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "name": "network-vif-unplugged", "status": "completed", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:01:41.309210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:41.309687 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:41.310324 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:41.325258 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.compute.server_external_events [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] Unable to find a host for instance 172b351d-94a9-4234-8228-87730325dd7d. Dropping event network-vif-unplugged {{(pid=118982) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 14:01:41.326142 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-acb5c186-4660-4fda-89c9-f5da3a7d728a req-241959ce-1d72-4123-a67a-51443678bd5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089196 Oct 19 14:01:41.326727 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1537/3147] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 14:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 14:01:42.139501 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:42.140476 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:42.154197 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:42.155047 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:42.156090 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:42.158461 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:42.159221 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:42.160267 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:42.296591 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:42.304776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-abedf360-0278-487b-a366-98ceb2d328db tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1519 microversion: 2.1 time: 0.171756 Oct 19 14:01:42.305386 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1611/3148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:42 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:43.328326 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:43.328957 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:43.336157 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:43.336633 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:43.337084 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:43.337772 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:43.338212 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:43.338824 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:43.473035 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:43.481033 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-1908bdb5-3ff7-4e24-a3fa-2feaa0d6063e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1521 microversion: 2.1 time: 0.156949 Oct 19 14:01:43.481567 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1538/3149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:43 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:44.503770 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:44.504380 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:44.511433 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:44.511893 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:44.512328 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:44.513051 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:44.513505 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:44.513924 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:44.646298 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:44.654712 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9c29567d-79ec-46df-a7fb-3d0a7a7e739b tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.154825 Oct 19 14:01:44.655294 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1612/3150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:44 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:45.678973 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:45.679886 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:45.688920 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:45.689388 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:45.689895 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:45.690530 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:45.690982 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:45.691407 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:45.856396 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:45.871225 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-52df00f5-bb7c-4275-89d9-42f727983ed2 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.196477 Oct 19 14:01:45.872062 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1539/3151] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:45 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:46.909099 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:46.910148 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:46.921599 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:46.922396 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:46.923112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:46.924238 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:46.925023 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:46.925727 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:47.066272 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:47.074920 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-4f24548b-1b87-4475-b86c-c23f8eb76f03 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.172424 Oct 19 14:01:47.075464 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1613/3152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:46 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:48.102754 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:48.103451 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:48.111083 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:48.111614 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:48.112091 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:48.112854 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:48.113389 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:48.113849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:48.249849 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:48.261789 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-70412405-7b12-4e1e-8146-8eeca332af78 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.165462 Oct 19 14:01:48.262689 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1540/3153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:48 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:49.293653 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:49.294700 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:49.305618 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:49.306103 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:49.306538 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:49.307229 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:49.307679 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:49.308102 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:49.448184 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:49.456112 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-d199ea69-7612-42bc-91d2-5106958ba055 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.169087 Oct 19 14:01:49.456677 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1614/3154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:49 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:50.483852 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:50.484829 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:50.494870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:50.495361 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:50.495797 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:50.496510 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:50.497006 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:50.497431 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:50.647870 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:50.655936 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-989a24ca-9060-44c4-8203-baa87b474f46 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.178734 Oct 19 14:01:50.656514 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1541/3155] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:50 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:51.683884 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:51.684757 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:51.695654 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:51.696630 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:51.697140 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:51.697866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:51.698323 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:51.698760 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:51.838614 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:51.847374 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-c972ed90-8d51-481b-bb2e-4d1e7851a851 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.170424 Oct 19 14:01:51.847943 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1615/3156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:51 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:52.875522 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:52.876458 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:52.887387 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:52.888174 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:52.888918 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:52.890056 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:52.890801 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:52.891488 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:53.030757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:53.043018 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-57213864-894c-4535-b2e3-fb794ba88834 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.173876 Oct 19 14:01:53.043804 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1542/3157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:52 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:54.073172 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:54.073776 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:54.080912 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:54.081417 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:54.081854 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:54.082535 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:54.082984 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:54.083407 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:54.102937 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:54.229031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:54.237031 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-39904569-8b96-487b-8f54-a8c3edc18144 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.169326 Oct 19 14:01:54.237597 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1616/3158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:54 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:55.260235 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:55.261364 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:55.263757 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:55.269490 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:55.269971 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:55.270395 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:55.271085 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:55.271537 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:55.271954 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:55.275269 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:55.359111 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "name": "network-vif-plugged", "status": "completed", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:01:55.367947 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=31 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:01:55.370268 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:55.370740 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:55.371239 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:55.383213 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.compute.server_external_events [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] Creating event network-vif-plugged:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 14:01:55.388463 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [req-60d5e6a8-61f6-45bc-82e7-f281665ef7d4 req-a62a7e32-3a8b-422c-a8b6-42c638a88a79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033075 Oct 19 14:01:55.389260 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1617/3159] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 14:01:55.423960 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:55.432855 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-8f13f5cf-169e-4358-b6f6-2b65ee980508 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.176319 Oct 19 14:01:55.433497 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1543/3160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:55 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:56.458262 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:56.458932 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:56.465734 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:56.466212 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:56.466639 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:56.467339 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:56.467781 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:56.468199 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:56.617119 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:56.625196 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-54cd2d72-c264-4704-921e-fdc82762d9ce tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1577 microversion: 2.1 time: 0.171715 Oct 19 14:01:56.625771 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1618/3161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:56 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:01:57.652464 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:01:57.653327 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:01:57.663620 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:57.664457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:57.665210 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:57.666337 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:01:57.667140 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:01:57.667555 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:01:57.806494 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:01:57.819545 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-91e664d1-a36d-4613-86cd-641bf5664259 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1564 microversion: 2.1 time: 0.173733 Oct 19 14:01:57.820094 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1544/3162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:01:57 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:03:14.606753 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b57fe2dc-35a6-4afd-92e9-314baf7ea7a6] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 14:03:14.607326 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_api:SELECT=3 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:03:14.608033 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG dbcounter [-] [118983] Writing DB stats nova_cell1:SELECT=10 {{(pid=118983) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:03:14.613917 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:14.614110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_api:SELECT=3 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:03:14.614531 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:03:14.615127 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG dbcounter [-] [118982] Writing DB stats nova_cell1:SELECT=11 {{(pid=118982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 14:03:14.616121 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 14:03:14.616467 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 14:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 14:03:14.618097 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 14:03:14.618282 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Wed Oct 19 14:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Oct 19 14:03:14.630638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:14.631230 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:14.631668 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:14.632430 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:14.634576 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:14.635011 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:14.660903 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Going to try to terminate instance {{(pid=118983) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 14:03:14.681143 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:03:14.691247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:14.691819 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:14.692206 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:14.704168 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] Creating event network-changed:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 14:03:14.710587 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-a5feb8a4-5d13-44d4-8b17-895362177f1a req-e5280f64-65f3-4cf1-8957-8d47b7a92043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102479 Oct 19 14:03:14.711793 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1545/3163] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 14:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 14:03:14.760299 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-1d1c8f31-1eee-4fba-bcac-9ddf918b4f19 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "DELETE /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 204 len: 0 microversion: 2.1 time: 0.154695 Oct 19 14:03:14.764060 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1619/3164] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Oct 19 14:03:14 2022] DELETE /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 14:03:14.772792 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:14.773868 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:03:14.781358 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:14.782902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:14.782902 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:14.783110 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:14.783652 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:14.783959 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:14.918589 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.policy [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118982) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:03:14.926839 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-590ded33-0e07-4093-bd2e-f78dc6759de8 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.160599 Oct 19 14:03:14.927429 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1546/3165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:03:14 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:03:15.950925 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:15.951638 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:03:15.959635 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:15.960147 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:15.960570 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:15.961307 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:15.961743 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:15.962171 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:15.969883 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO oslo.messaging._drivers.impl_rabbit [-] [b57fe2dc-35a6-4afd-92e9-314baf7ea7a6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 39876. Oct 19 14:03:16.109202 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:03:16.117866 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-9f605b0f-b340-416d-859c-25167dc71f59 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1570 microversion: 2.1 time: 0.171368 Oct 19 14:03:16.118409 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1620/3166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:03:15 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:03:16.730074 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b351d-94a9-4234-8228-87730325dd7d", "name": "network-vif-deleted", "tag": "caa8a425-66a5-4353-8315-dc1da976f5cb"}]} {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 14:03:16.741247 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:16.741720 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:16.742891 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:16.754984 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.compute.server_external_events [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] Creating event network-vif-deleted:caa8a425-66a5-4353-8315-dc1da976f5cb for instance 172b351d-94a9-4234-8228-87730325dd7d on hv-cinder-maste Oct 19 14:03:16.760740 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [req-e3f48563-27d8-4f4f-90d7-810294bb18a3 req-c209a539-b578-418c-956d-3052e12875f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035393 Oct 19 14:03:16.761365 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1547/3167] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Oct 19 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 14:03:17.142054 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:17.142782 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.compute.api [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118983) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:03:17.150224 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:17.150647 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:17.151077 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:17.151765 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:17.152228 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:17.152657 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:17.183383 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:17.183863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:17.184295 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG oslo_concurrency.lockutils [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:17.184729 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.objects.instance [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lazy-loading 'fault' on Instance uuid 172b351d-94a9-4234-8228-87730325dd7d {{(pid=118983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 14:03:17.230552 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.policy [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f75c86d3da4dc1ba3da370f94d7885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6650694dfd04f6eb1e32c5bf16e7e71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118983) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 14:03:17.238284 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-94e00950-a8e3-437f-bc49-28b0f3d4387e tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 200 len: 1224 microversion: 2.1 time: 0.100505 Oct 19 14:03:17.238863 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1621/3168] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:03:17 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 14:03:18.265686 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '>' {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:18.266808 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.compute.api [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] [instance: 172b351d-94a9-4234-8228-87730325dd7d] Fetching instance by UUID {{(pid=118982) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 14:03:18.278073 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:18.278862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:18.279563 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:18.280679 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Acquiring lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 14:03:18.281457 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 14:03:18.282135 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG oslo_concurrency.lockutils [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Lock "92222fa4-c6fd-435b-a56b-90c4f494d59a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 14:03:18.298418 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.wsgi [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] HTTP exception thrown: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Request method failure captured: Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: request: GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d HTTP/1.1 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept: application/json Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Accept-Encoding: identity Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Connection: close Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Length: 0 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Content-Type: application/json Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Host: 10.222.0.17 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: Openstack-System-Scope: None Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: User-Agent: python-urllib3/1.26.12 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Auth-Token: gAAAAABjUAKMox9Op-y6iQkzSIN_EXPq6_OKVuMf1mx_GLB9MiPKEupmytlnIkZndg-8_r8CLiBk7lINrLYlHtjzMGk_oUg4i75d3juCBFbmJMrveoADF37m0WbiZ9dX-Fvljx6O0gtMmOjX18ExS3xK2cgtYAQHhRU96kd4ERox4pTIqj0J9SA Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Id: None Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Domain-Name: None Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Identity-Status: Confirmed Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Is-Admin-Project: True Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Id: default Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Domain-Name: Default Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Id: c6650694dfd04f6eb1e32c5bf16e7e71 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Project-Name: tempest-TestShelveInstance-296834533 Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Role: reader,member Oct 19 14:03:18.300070 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Roles: reader,member Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c6650694dfd04f6eb1e32c5bf16e7e71", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6650694dfd04f6eb1e32c5bf16e7e71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c6650694dfd04f6eb1e32c5bf16e7e71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c6650694dfd04f6eb1e32c5bf16e7e71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}] Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant: tempest-TestShelveInstance-296834533 Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Id: c6650694dfd04f6eb1e32c5bf16e7e71 Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-Tenant-Name: tempest-TestShelveInstance-296834533 Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User: tempest-TestShelveInstance-296834533-project Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Id: default Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Domain-Name: Default Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Id: d9f75c86d3da4dc1ba3da370f94d7885 Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: X-User-Name: tempest-TestShelveInstance-296834533-project Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: method: > Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: exception: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. Oct 19 14:03:18.301821 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: action_args: {'id': '172b351d-94a9-4234-8228-87730325dd7d'} Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: {{(pid=118982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 14:03:18.302862 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. Oct 19 14:03:18.304708 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: ERROR nova.api.openstack.wsgi Oct 19 14:03:18.306096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: DEBUG nova.api.openstack.wsgi [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Returning 404 to user: Instance 172b351d-94a9-4234-8228-87730325dd7d could not be found. {{(pid=118982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 14:03:18.306096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: INFO nova.api.openstack.requestlog [None req-f8f14ed4-d67f-497f-b2e8-55cea1f341c1 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d" status: 404 len: 111 microversion: 2.1 time: 0.042825 Oct 19 14:03:18.306096 dv-cinder-master-3-iscsi devstack@n-api.service[118982]: [pid: 118982|app: 0|req: 1548/3169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Oct 19 14:03:18 2022] GET /compute/v2.1/servers/172b351d-94a9-4234-8228-87730325dd7d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 14:03:18.462994 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: DEBUG nova.api.openstack.wsgi [None req-62634d9b-cf9b-4a3a-bf7b-f666a0b86517 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] Calling method '.version_select at 0x7ff4fca43e50>' {{(pid=118983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 14:03:18.491954 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: INFO nova.api.openstack.requestlog [None req-62634d9b-cf9b-4a3a-bf7b-f666a0b86517 tempest-TestShelveInstance-296834533 tempest-TestShelveInstance-296834533-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-952342483" status: 202 len: 0 microversion: 2.1 time: 0.033156 Oct 19 14:03:18.495682 dv-cinder-master-3-iscsi devstack@n-api.service[118983]: [pid: 118983|app: 0|req: 1622/3170] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Oct 19 14:03:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-952342483 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)